published on : Sunday, June 23, 2024
After reading Daniel Kahneman's book "Thinking, fast and slow", I changed my approach towards a few situations that regularly arise in my day-to-day. It's probably the most influential book I have read in recent memory.
One of the key insights in his book is the stark difference between how we experience life, and how we remember it. Kahneman splits our sense of self into two parts: The "experiencing-self", and the "remembering-self". He shows how they often produce contradictory answers when asked the same question. In other words, we have terrible recollection capacities even though it seems like we remember things well-enough.
Having learned this, I changed my process towards writing interview feedback after I interview someone.
At most tech companies, there are guidelines around when the interview feedback is due - that is, the time given for interviewers to enter their notes and feedback into the system. Typically, this is 24 hours. Of course, if a candidate is interviewed on a Friday, the interviewers will be given until Monday to enter their notes and provide a rating which will be used to determine hire/no-hire decision once all the feedbacks come in.
The problem of course, is that 24 hours is far too long. It's too much time after the interview is over.
Given the evidence that the experiencing and remembering selves produce different answers to the same question, if an interviewer sits down to write their feedback, it's highly likely that the feedback they write is written from their remembering-self, and it completely ignores what actually happened during the interview. This is sub-optimal for obvious reasons.
Worse, given the evidence Kahneman provides about how the environment primes/clouds individuals' judgement, a whole host of other things are at play when the interviewer interviews/writes feedback:
-
Priming and/or Anchoring effect - is the interviewer in a good mood or a bad mood? did they have two interviews they accepted back-to-back on successive days, and the feedback for candidate #1 is still due? - This can impact the feedback that will be written, given that the interviewer has just finished talking to a much better/worse candidate. Instead of being evaluated against a (somewhat fixed) hiring bar, the candidates are now evaluated relative to each other.
-
Blood sugar levels: Kahneman also shows how our blood sugar levels play a role in whether we judge a situation harshly or not-so-harshly. Given we are passing judgements about technical candidates, it's important to nullify the effect of this variable as much as possible.
-
Cognitive dissonance: Consider a good interviewer who takes diligent notes throughout the interview and is very keen to write feedback which is accurate. When they sit down to enter their feedback and consult their notes, but their remembering self produces a low-fidelity version of the previous day's interview, they may miss important things and highlight the not-so-important things (depending on the situation, this can be either favorable or unfavorable to the candidate). To the interviewer, when their two selves contradict each other inside their head, the remembering-self often wins because we all believe "Oh yeah! that's what happened". Cognitive dissonance like this produces bad outcomes.
To fix the problems above, my process these days is something like this:
-
Ensure I'm well-fed before I start the interview. This means, I will never interview a candidate on an empty stomach. I will also never write feedback when I'm hungry.
-
Ensure I take tons and tons of notes during the interview. This will ensure I'm capturing my experience with high fidelity.
-
Ensure I submit my interview feedback within one hour of the interview. This will ensure that the feedback I have written is the feedback produced by my experiencing self instead of my remembering self.
-
Always, always write down the rating which I feel the candidate gets on their performance, and make it immutable. I do this every single time without fail. Even if I cannot write my entire feedback immediately, I take my time to consider a candidate's performance and assign them a rating. I spend ample time coming up with this number. I'm not allowed to change it after I settle on it (once I have written it down).
-
In case it's not possible to enter my interview feedback immediately after I interview someone, I make it a point to write the feedback from the perspective of my past experiencing-self - That is, if I suffer cognitive dissonance, the notes I have taken "win" over what my mind is now saying (remembering self's judgement is discarded).
-
Avoid accepting back to back interview requests if I feel there isn't enough time to complete feedback for the first candidate. In case such requests come in, either swap the second interview request with someone else or decline politely.