Tech interviews, too much homework, and the motherhood question

There’s a fascinating discussion around technical interviews recently; would both candidate experience and hiring signal be improved by revising the current round of (basically Google-inspired) non-runnable algorithm-centric coding examples completed under time pressure?

I’ve been following Thomas Ptacek’s tweets about it for a few months, for example:

Then last week Julia Grace wrote A Walkthrough Guide to Finding an Engineering Job at Slack:

We’ve put a great deal of effort into designing our interview process so that it is comprehensive and consistent, and are working hard to remove as many points of bias as possible. To date we’ve found it successfully identifies people who will succeed here — those with a high degree of technical competence who also embody Slack’s values: empathy, courtesy, craftsmanship, solidarity, playfulness, and thriving[…]

We’d like to get an idea of how you write code in the real world, since we feel this is the best indicator of how you’d write code day to day here at Slack. Granted, the Slack codebase is larger and more complicated than any technical exercise, but we have found the technical exercise to be a good indicator of future performance on the job. There are great engineers at big name companies and at small ones, so this gives everyone a chance to shine independent of where they are now.

This varies by position, but generally you’ll have a week to complete a technical exercise and submit the code and working solution back to us.

Uncritical praise of take home exams started to ring alarm bells for me. I recall take home exams from university; one of my majors was philosophy, which tended to assign a long essay (eg, 4000 words) to be completed over 6 weeks or so, and a take-home exam (eg, 2 essays of 1000–2000 words) to be completed with a four day deadline. I moved out of a rural town to go to university and lived on my own. From age 19, I also financially supported myself. I loathed take home exams, because I was competing with people who would get the exam, go home, and work on it all week in the house they lived in with their parents. No job. No housework. (Admittedly, no self-imposed decision to take 125% of a normal course load every year for four years of university either, that one was on me.)

And that was before I had two children. I’m not at all excited about tech interviews moving to a model where I’m doing a huge amount of work in my own time, because I do not have a huge amount of free time. Anecdotally, I have already heard of people spending in excess of 20 hours on Slack’s coding exercise. Freeing 20 hours in a week is a non-starter for me, especially if I’m not a clear finalist for the job. Slack is administering these take home assignments prior to on-site interviews, and is a very sought after workplace; it’s quite possible their process will be widely copied and people will regularly be doing a couple of days of coding before in-person interviews, for many many jobs.

To be fair, I have also read through Steve Yegge’s Get that job at Google and estimate that, at my current levels of free time, it would probably take me a couple of years to complete the preparation he recommends. (I have an undergraduate degree in computer science and mathematics — the philosophy major was a separate degree — and a PhD in computing, but at this distance I am far from passing an exam in discrete maths.) But I also wouldn’t be required to submit work samples proving I’d spent that time.

I am also aware that other positions require extensive preparatory work for job interviews for senior candidates, such as preparing sample budgets or strategy presentations or similar, but it’s at least more common only to give such large amounts of work to later-stage candidates for the position.

Let’s not get uncritically excited about adding (yet another!) screen for “isn’t a mother of young children”. I am thrilled that Camille Fournier has made several similar points in Thoughts on Take Home Interviews (also available on her blog):

On twitter, a discussion ensued about whether asking people to spend time at home doing exercises didn’t itself cause bias, against those who did not have a lot of spare time to be doing take-home exercises. Julia mentioned that they expect it to take 2–4 hours, but admitted that some people got really into the project and spent far longer than that[…]

The creative take-home also seems likely to select for those with free time, because if it is really an exercise that some people want to overdo, they will overdo it and you will have a hard time not rewarding that enthusiasm (why shouldn’t you!). And while it’s ok to ask for a few hours, building something that rewards those who can spend far longer is likely to bias against those who have, say, kids to take care of after work and on weekends, or other activities that limit their free time.

Gaëtan Voyer-Perraul also notes in a reply:

If this thing catches on, then it’s going to become a gating mechanism for every developer job in existence. New grads will be faced with hundreds of hours of “take-home” work that goes into the same black hole as their resumés.

Also worth a read: Rod Begbie gives a postmortem of a take-home interview question he used to administer.

I’m excited about revising the technical interviewing process, which will require both experimentation and evidence. While experimenting, and as the tech industry actively seeks candidates from under-represented backgrounds, the ability of candidates to interview with your organisation without tens of hours of free time for take-homes in addition to time for on-site interviews should be a core design principle for your interview process.

Why is someone’s entire adult life relevant to their job application?

This article originally appeared on Geek Feminism.

Over at Captain Awkward’s advice column, there’s a question about how to deal with a recent name change when potential employees may call references that know you by a former name. The advice moves a little into how to deal with “resume gaps” in general:

Prospective employers will ask difficult questions about gaps in employment, changes of field, etc., but often they are doing it because they want to see how you react to the question before they decide if it is an actual issue. They want to make sure that you didn’t lie on your resume. They want to see if you have a coherent reason for whatever it is. And they want to see if you react with grace under pressure, or if you turn into a defensive weirdo… [P]lenty of people take time out of the workforce to care for kids, go to school, look after aging relatives, etc. and then are in the position of trying to get back into the workforce. If an employer is going to hold your years as a caregiver or student against you in making a hiring decision, that is their bad. Do not apologize! Do not talk about how your skills are “rusty”! If they say “I notice it’s been a few years since you’ve been working in this field, what’s up with that?” say “Yes, I was lucky enough to be able to take some time off to care for my mom at the end of her life,” or “Given the cost of day care, it made sense for one of us to stay home with the kids for a while” or “Yes, it was strange to be a grad student-by-day, bartender-by-night, but my customers were great and I learned a lot from having such a public-oriented position” and then ask a question about the position at hand.

It’s possible to disagree for pragmatic reasons with the advice to disclose here (see for example annalee’s comment on that post), but I wanted to move away from the question of what individual jobseekers should do — to be clear: I don’t fault Captain Awkward discussing that, it’s an advice column! — to the general question of why this comes up. Why do resume gaps matter, exactly? Why is a job candidate who has several unexplained years on their resume a worse candidate for a job?

Here’s my hunch about why it matters: because it’s a proxy for discriminating against (former or currently) ill or disabled people and carers, pretty much. And people with a history of institutionalisation, and others. So at an individual level you can disclose on the principle that while it sucks that there are powerful bigoted people out there, it’s better to find out that they’re bigoted against you before you’re working for them. Or you can not disclose on the principle that while it sucks that there are powerful bigoted people out there, you might be able to stay mostly under their radar when you are working for them. Not the most excellent choice in the world!

This seems in some ways hackable to me. This isn’t a new insight, but part of the problem with hiring is the need to choose one person (or N people), and, typically, having more than N applicants. You need some tools to eliminate people, so people come up with petty absolutes about resumes that are in the wrong font, or are one page long, or aren’t one page long, or that cover letters that use “I am writing to apply for” rather than “I am applying for” or whatever you like. And of course it’s easy to fall into bigotry too. The ideal worker bee is young and male and “flexible” and so on. If society has squashed someone down by keeping them out of the workforce, you don’t want your organization to have to pay the price for the squashing, so let’s require an age-21-to-present-time employment history too. Some people have that, after all.

There’s a real problem with resume gaps, which is that they might be actually relevant time that the person doesn’t want to talk about with you (for example, the employer they defrauded), but I think it’s at least worth questioning the idea of pushing down on everyone who has ever been out of the workforce in order to find them, and there’s definitely also a desire to ferret out “flakes” (people who you want to discriminate against) among some employers.

One possibility then is that by consciously letting go of the idea that your hiring skills guarantee getting the single best hire, or the belief that your resume filtering skills and interviewing skills are helping you past a certain point, and choosing randomly from the best M applicants as selected by your hopefully-consciously-avoiding-bigotry hiring process. And by letting go of your belief that you need total control in order to select The One, perhaps you can let go of at least some received wisdom about seeing “red flags” in any sign that someone may have done something with their weekdays other than work, and that they may not want to talk to you about that.

What received truths of hiring do you think are bogus or discriminatory?

Impostor syndrome and hiring power

This article originally appeared on Geek Feminism.

This is an Ask a Geek Feminist question:

What are some ways in which I can avoid rejecting people who suffer from impostor syndrome when they apply for a job?

I’ve recently been promoted to a position where I’m somewhat responsible for hiring people. I would like to increase the diversity of new hires, and so I’m more likely to put applications from women through to the interview stage.

Following that though I don’t want to lose out on quality applicants as they are modest about their achievements and abilities, due to impostor syndrome or otherwise.

Giving an automatic “+10 kickass” to every female applicant as they may suffer from impostor syndrome seems to be a strategy without much merit. Getting everyone to exhibit their full potential is clearly the better solution.

Can you suggest interview strategies that would create the environment in which women (and indeed anyone) will be better able to convince me of their suitability for the role?

I don’t have so many specific interview strategies, but I’ve got plenty of ideas for hiring strategies in general, I hope you can adopt some of them and perhaps our commenters can talk about the interview.

First, a should be obvious: a +10 kickass bonus may be illegal discrimination in your geographic area. If it is, definitely don’t do that.

With that out of the way, let’s talk about soliciting applications. Now, there’s a couple of things that stop some women at this point. First, there’s a tendency to regard themselves as underqualified for perfectly suitable jobs. Next, there’s concern that they needn’t bother, as a woman’s name will cause you to discount their resume. Some suggestions:

  1. get your signalling right. You want to say “women friendly employer” in your advertisements without discriminatory pro-women statements. This at least gets you past the “I’m not a man” part of impostor syndrome. Here’s some things you should be doing:
    • advertising all relevant open positions on a women’s job list such as, say, LinuxChix’s jobposts for open source jobs. This at least shows that you aren’t actively avoiding women applicants.
    • including on your full ads the “equal opportunity” boilerplate you might be able to find on other local job ads
    • including information on the “Careers” section of your website about your carer leave, your retirement contributions, your shared sick leave pool, your friendliness to part-time employees if any of these hold

    Not only are these things attractive to many women (and yes, some men as well) in and of themselves, they also signal in various ways that when you picture your new hire, the picture isn’t young, white, able-bodied, male, etc etc.

  2. if your employer has recently had a similar (especially perhaps slightly more junior) position available, get the resumes of the people who were considered the better applicants from the hiring manager, HR person or recruiter, and re-consider them for the new position (probably there would need to be some kind of process of tracking and perhaps re-application here, but I’ll handwave that problem to you).
  3. consider internal employees in more junior positions as potential applicants. Depending on the size of the company, other managers might be able to recommend people to you who are overqualified for their position (or possibly not, if they are getting good work from them)
  4. consider whether you really need experience that skews very very male. For example, does someone have to have open source development experience? Are there alternative ways that someone could have learned the skills you need?

And now for considering applications prior to interview:

  1. you may not be able to say you’re doing this, but in order to avoid bias on the basis of gender or other demographic characteristics, for as long as possible in the process keep names off resumes. Have names and addresses scraped from resumes by someone before you see them, and do as much ranking as you can prior to finding out the names and details of the applicants.
  2. avoid judgements about cultural fit at this stage.
  3. there are reasons companies rely on the recommendations of existing employees, but for each open position, try and select some applicants for interview who didn’t come in via the company networks in order to avoid duplicating your company’s present demographic by hiring all their friends

In the interview itself here is a strategy for getting people to talk about their successes when they are susceptible to impostor syndrome (note that any candidate might be part of an oppressed group, so don’t limit these to women candidates): ask about something the candidate did that benefited someone else. How did they save their company money or helped a team member learn what they needed to know? Present them with cooperative scenarios where they need to help you or your employer do something as well as or instead of competitive scenarios where they need to prove they are the single right person for the position. If anyone can flesh this out to specific example questions in the comments, that would be useful.

I strongly recommend reading Women Don’t Ask by Linda Babcock and Sara Laschever for good solid information both about women’s negotiation and self-promotion strategies and why they use those strategies, namely, that competitive and aggressive interpersonal strategies are simply not effective for most women because of negative responses to perceived aggression in women.

Is requiring Open Source experience sexist?

This article originally appeared on Geek Feminism.

Code Anthem’s Don’t Judge a Developer by Open Source (via Meg in the Open Thread) argues that companies that rely on Open Source coding contributions as a hiring criterion are both demanding a lot of their hiree’s free time and are sexist:

Open source is a culture. There are plenty of smart and passionate developers out there who are not part of that culture. And certainly there are plenty of dumb and curmudgeonly developers out there participating in open source…. There are there smarter ways to spend your time. The stereotypical open source developer works for a bumbling corporate during the day, doing dull work (but necessary to make money) and then comes home to work on his passion, OpenOKHRWUJ Framework…

Requiring open source contributions is sexist… Open source is dominated by men even more so than the programming community as a whole… it’s irresponsible to require your new hire developers to come from a male-oriented pool. Alas”¦ “Underrepresentation breeds underrepresentation”.

I have a comment in moderation there in which I say that I think the stereotype is incorrect: that Open Source developers in my experience are either university students or other young people with a lot of free time, or they’re paid Open Source developers. (I know hobbyist Open Source coders with unrelated dev or other full-time jobs too, yes, but not nearly so many and their contributions are for obvious reasons usually not as significant. If nothing else, this group has a really high incidence of typing injuries.)

But that’s a side-note: I think the core point of the post stands. Open Source is very male-dominated, is known for being unpleasantly sexist, and is also a subculture whose norms (even where neutral as regards sexism) don’t fit everyone. Requiring these norms feeds right into the problem talked about in Being Inclusive vs Not Being Exclusive:

People who come from underprivileged minorities are usually very experienced in the art of being excluded. Sometimes it’s overt – “we don’t like your kind” – but many times it’s subtle. They’re told that they’re “not quite right”, or they “don’t have the right look”, or “don’t have the right experience”, or just aren’t told anything. At the same time, they are surrounded by all sorts of imagery and communique about how they don’t quite belong, about how they have to change themselves to fit in, about how they are undesirable. They do not see a lot of examples they can relate to; even the ones that come close tend to stick out for being “Exotic”, being a token. They already have a lot of barriers against them and are already of the mind that they’ll more likely be rejected than accepted.

If you insist on a lot of experience in a particular male-dominated sub-culture as a prerequisite for a job, that reads as “we prefer [a subset of] men, basically, or at least people willing to work hard to minimise all the ways in which they aren’t [part of the subset of] men” even if you didn’t intend it to and even if you didn’t want it to.

Code Anthem isn’t, as far as I can tell, thinking about Open Source paid jobs in that post, but they of course have this problem magnified. It seems vastly reasonable on the face of it: hiring existing Open Source contributors, ideally people from your very own community, means you hire people who are well-versed in the particular mode of development you do, in particular, the use of text-based mediums for communicating among a distributed team. Since Open Source (or more to the point Free Software) projects are at least sometimes associated with particular non-commercial goals and philosophies agreement with those seems desirable. But since most long-term Open Source developers need to be paid for it, it strongly feeds into this cycle of long-term Open Source developers continuing to be male and of a particular kind of culture, and continuing to overtly or subtly signal that that’s who is welcome in Open Source development.

Possible other posts of interest:

  • Terri’s Want more women in open source? Try paying them.
  • Dorothea Salo’s Sexism and group formation:

    A woman can be an honorary guy, sure, with all the perquisites and privileges pertaining to that status””as long as she never lets anything disturb the guy façade.

    It’s good to be an honorary guy, don’t get me wrong. Guys are fun to be around. Guys know stuff. Guys help out other guys. Guys trust other guys. And in my experience, they don’t treat honorary guys any differently from how they treat regular guys. It’s really great to be an honorary guy.

    The only problem is that part of the way that guys distinguish themselves from not-guys is by contrasting themselves with women.