Why smart managers do stupid things

Large firms hire some of the smartest, most capable people. Yet, when those people become managers, they do stupid things.

For example, they cling to concepts like “pay for performance” and “talent management” without any critical thinking – without questioning whether the systems and processes in place actually work.

When it comes to management, there’s a clear absence of intellectual rigor. And I always wondered: “Why?”

Thinking Fast and Slow

Recently, I came across an answer that’s both encouraging and dispiriting. It’s because of the way our brains work.

In the brilliant book, “Thinking Fast and Slow”, Nobel prize winner Daniel Kahneman describes the brain as having two systems:

“System 1 operates automatically and quickly, with little or no effort and no sense of voluntary control.

System 2 allocates attentions to the effortful mental activities that demand it, including complex computations.”

If you see two objects, for example, you’ll use System 1 to detect which one is further away. But to calculate the distance, you’ll use System 2. While System 1 is easier for us – largely automatic – System 2 can come up with a better answer.

But using System 2 requires effort and attention. And attention is a scarce resource. So we systematically take shortcuts so we can make sense of the world around us.

Kahneman’s book is full of incredible insights. Chapter after chapter, you’ll face uncomfortable truths about how you think, all grounded in excellent research and careful studies, yet written so all of it is accessible and engaging.

Of the many fascinating stories in the book, two struck me as particularly relevant to management practices at most firms.

The Illusion of Validity: Evaluating Leaders

Throughout the book, Kahneman refers to the WYSIATI principle – What You See Is All There Is. Over and over, he demonstrates how people systematically disregard basic probability and other facts in order to (quickly and easily) make up a story that fits with the things they see.

“The sense-making machinery of System 1 makes us see the world as more tidy, simple, predictable, and coherent than it really is.”

Kahneman describes a story from the Israeli Army, where he participated in a formal review to determine soldiers’ leadership abilities, complete with a numerical rating, detailed observations, and a recommendation per soldier.

Months later, they were able to learn how well the candidates actually performed in officer-training school and, repeatedly, the correlation between the leadership evaluation and actual performance was negligible.

But that didn’t change anything.

“The dismal truth about the quality of our predictions had no effect whatsoever on how we evaluated candidates and very little effect on the confidence we felt in our judgments and predictions about individuals.

We knew as a general fact that our predictions were little better than random guesses, but we continued to feel and act as if each of our specific predictions was valid…Because our impressions of how well each soldier had performed were generally coherent and clear, our formal predictions were just as definite.”

It was a case of WYSIATI. The evidence in front of them (impressions of the soldiers) outweighed their knowledge about their flawed process, and gave them an illusion of validity.

Every firm with a “talent management” process, rigorously evaluating employees’  potential, is subject to that same illusion.

The Illusion of Validity: Rewarding Results

Decades after his experience in the Israeli Army, Kahneman was invited to speak to a group of investment advisers.

Before the talk, he analyzed the investment outcomes of the advisers over eight consecutive years. Then he computed correlations to see if there were differences in skill. The results “resembled what you would expect from a dice-rolling contest.”

“Our message to the executives was that, at least when it came to building portfolios, the firm was rewarding luck as if it were skill…But their own experience of exercising careful judgment on complex problems was far more compelling to them than an obscure statistical fact.”

Unfortunately, every performance review and every distribution of performance rankings suffers from these same biases. And yet we persist.

After his talk, Kahneman spoke with one of the investment advisers:

“He told me, with a trace of defensiveness: ‘I have done very well for the firm and no one can take that away from me.'”

What successful manager would want to admit that their success is largely due to chance? That the system that promoted them was fundamentally flawed?

The Red Beads

But we’ve known all this for decades – even without the additional proof in Kahneman’s work.

Deming talked about the inherent errors in most evaluations of performance, and he wrote about it in the early 1980s in “Out of the Crisis”:

“A common fallacy is the supposition that it is possible to rate people; to put them in rank order or performance…The performance of anybody is the result of many forces – the person himself, the people that he works with, the job…his customer, his management…

These forces will produce unbelievably large differences between people. In fact, as we shall see, apparent differences between people arise almost entirely from action of the system that they work in, not from the people themselves. A man not promoted is unable to understand why his performance is lower than someone else’s. No wonder; his rating was the result of a lottery.”

Deming then introduced the Red Bead experiment to prove his point. In that experiment, workers with the same skills, instructions, and tools are put in front of a bin of red and white beads and asked to select only white beads (not red ones) with a special paddle. And they produce wildly different results.

The process is “in control” and the variations are to be expected.

“It would obviously be a waste of time to try to find out why Terry made 15 red beads, or why Jack made only 4. What is worse, anybody that would seek a cause would come up with an answer, action on which could only make things worse henceforth.”

“Anybody that would see a cause would come up with an answer.” Make up a story to fit the facts. Kahneman couldn’t agree more.

What to do?

So, our brains’ ability to make sense of the world involves some devastating trade-offs in terms of biases and systematic errors. But if we’re wired to make substitutions, to overlook simple statistics, to make up causes and coherent stories where there’s only luck, then is there anything we can do?

Yes.

We can recognize that “the laziness of System 2 is an important fact of life.” And that “System 1 is radically insensitive to both the quality and the quantity of information that gives rise to impressions and intuitions.”

Knowing our natural tendencies and biases, we can ask more questions. We can insist on more evidence.

“The way to block error that originate in System 1 is simple in principle: recognize the signs that you are in a cognitive minefield, slow down, and ask for reinforcement from System 2.”

We can think more. We can refuse to accept management practices that don’t work just because that’s the way things are.

We can do better.

Advertisements

About John Stepper

Driving adoption of collaboration and social media platforms at Deutsche Bank. (Opinions here are my own.)
This entry was posted in Management and tagged , , . Bookmark the permalink.

12 Responses to Why smart managers do stupid things

  1. Hey_Eight says:

    Good article, again, John.
    I really liked – ““A common fallacy is the supposition that it is possible to rate people; to put them in rank order or performance” How many COO’s/CFO’s force managers to rank their staffs on a bell curve during performance reviews. The validy and usefulness of the reviews rarely seems worth the time spent and the agnst created. Someday, somewhere organizations will begin to catch on and spend time doing productive things vs. reviews.

  2. Pingback: What if unproductive work is simply a habit? | johnstepper

  3. Chris Larson says:

    Thanks for sharing, I hadn’t thought about there being two systems for thinking. This is also good to know for non-managers, so that we can play to system 1 for promotions, while making sure our efforts are strongly supported when evaluated by system 2.

  4. Great post, John. Have been thinking about this topic for some time. We’ve been talking about learning organizations for a long time, but why is it so hard to actually be a learning organization? Giving people time to think (slack) is a ‘solution’, but the problem is people don’t have, take or get time to think. I’m wondering how we can get people to take time to think. A course like you’ve been giving can help. Leading by example is also a way. Other ideas?
    And thanks for pointing me to the book. Will read it.

  5. RevioCTO says:

    Good post. I’ve also recently read the book you mention, it is well worth the time!

  6. Pingback: Curious Cat Management Improvement Blog Carnival #174 « Design of Experiments Doe

  7. Hi John

    Thank for the great thoughts and sharing information on an important subject.

    It reinforces the fact that our whole system is based on very large faklse assumptions. We see them every single day yet rarely does anyone do anything about them. We have been put to sleep mentally, by our media, education, financial, and polictical systems. When ever some company steps out of line with conventional practises, by simply stopping and thinking about what they should actually do and how they should do it they are rewarded.

    Southwest Airlines did it in the airline business, and oithers have followed their lead and succeeded as well, while all those that follow conventional airline wisdom still go up and down like yoyos.

    LG and Samsung the Korean appliance and TV makers, have made great strides due to the fact they thinkout their product innovations, and do not go with the conventional wisdom. Their reward has been steady growth, and the respect and admiration of the consumers (they rate at or near the top for every major category).

    You can see it happening in other industries including insurance as certain companies break rank with traditionalk business models and go in new directions to build their business, and somehow overnight they seem to boom. The reality is they just stopped and thought about it, and realized that for them the old way of doing business was no longer worth it. They could do better and provide their customers with better service by changing their business model. Two examples are Geico in the USA and Belair Direct in Canada.

    We all need to stop and take time to think, but than that would require business and political leaders to actually want to try something different to solve their true problem. System I thinking is the reason we keep trying the more of the samething in the hope to get a different result. System II thinking is stopping and realiziing that it didn`t work before so we have to try something different, and taking the time to come up with something different.

  8. Pingback: The paradox of “they” | johnstepper

  9. Pingback: Stop stealing dreams at work | johnstepper

  10. Pingback: If someone offered you free career insurance, would you take it? | johnstepper

  11. Pingback: Dear reader | johnstepper

  12. Pingback: A better way to identify and develop talented people | johnstepper

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s