ANSWER PAGE

 

 

Expert Overconfidence

and the winning commentators are...

1. "That idea [that airplanes could sink battleships by dropping bombs on them] is so damned nonsensical and impossible that I'm willing to stand on the bridge of a battleship while that nitwit tries to hit it from the air." ...

US Secretary of War Newton Baker in 1921 reacting to Brigadier General Billy Mitchell's claims that airplanes could sink battleships.

2. "Heavier-than-air flying machines are impossible." ...

Lord Kelvin - British mathematician, physicist, and president of the British Royal Society, c. 1895.

3. "Reagan doesn't have the presidential look." ...

A United Artists executive - dismissing the idea that Ronald Reagan be offered the starring role in the 1964 movie, THE BEST MAN.

4. "A severe depression like that of 1920-1921 is outside the range of probability." ...

The Harvard Economic Society - a weekly letter on November 16, 1929.

5. "We know on the authority of Moses, that longer than six thousand years, the world did not exist." ...

Martin Luther [1483-1546] - German leader of the Protestant Reformation.

6. "[It would be] impossible! [that Cassius Clay could last six rounds in his upcoming bout with World Heavyweight Champion Sonny Liston in 1964.]" ...

Jimmy "The Greek" Snyder - odds maker.

What Happened?!

Expert Overconfidence

As we saw in the Overconfidence game, even experts are overconfident in their ability to predict. For experts there are additional difficulties that fuel their overconfidence, such as motivational and cognitive biases. Motivational bias affects the response that the expert "wants" to give, usually motivated a perception of reward or penalty. If I am a petroleum engineer, I want to think that petroleum will continue to play an influential role in the future economy.

Of various cognitive biases, expert overconfidence is most noted in the "confirmation" bias. Experts tend to look for data that confirms or supports their preliminary findings or beliefs. As an example, a marketing manager was researching her company’s competitive position in acquiring "new users" of her product to explain the recent decrease in market share, since this is where she did all of her marketing. It turned out that in actuality she was capturing a high percentage of new users, while losing a high percentage of current users, which she was not measuring. Thus, the lesson learned is that experts should ask disconfirming questions, such as "what data or causes would lead us to change our minds?" If the data does not exist, then the expert can be more confident in their opinion.

The systematic, operational approach that systems thinking applies to looking at complex systems provides the ground for asking those disconfirming questions. Additionally, through the use of the system dynamics simulator, experts are able to test their hypotheses about how the system works, to see if it really does work that way.