Michael Weimer

“Suppose someone says, “Unfortunately, the popularity of soccer, the world’s favorite pastime, is starting to decline.” You suspect he is wrong. How do you question the claim? Don’t even think of taking a personal shot like “You’re silly.” That only adds heat, not light. “I don’t think so” only expresses disagreement without delving into why you disagree. “What do you mean?” lowers the emotional temperature with a question but it’s much too vague. Zero in. You might say, “What do you mean by ‘pastime’?” or “What evidence is there that soccer’s popularity is declining? Over what time frame?” The answers to these precise questions won’t settle the matter, but they will reveal the thinking behind the conclusion so it can be probed and tested. Since Socrates, good teachers have practiced precision questioning, but still it’s often not used when it’s needed most. Imagine how events might have gone if the Kennedy team had engaged in precision questioning when planning the Bay of Pigs invasion: “So what happens if they’re attacked and the plan falls apart?” “They retreat into the Escambray Mountains, where they can meet up with other anti-Castro forces and plan guerrilla operations.” “How far is it from the proposed landing site in the Bay of Pigs to the Escambray Mountains?” “Eighty miles.” “And what’s the terrain?” “Mostly swamp and jungle.” “So the guerrillas have been attacked. The plan has fallen apart. They don’t have helicopters or tanks. But they have to cross eighty miles of swamp and jungle before they can begin to look for shelter in the mountains? Is that correct?” I suspect that this conversation would not have concluded “sounds good!” Questioning like that didn’t happen, so Kennedy’s first major decision as president was a fiasco. The lesson was learned, resulting in the robust but respectful debates of the Cuban missile crisis—which exemplified the spirit we encouraged among our forecasters.”
― Philip Tetlock, Superforecasting: The Art and Science of Prediction