Tag: Intelligence

Categories
AI

The Shape of the Question

Marc Andreessen made two claims recently that don’t quite fit together, and I haven’t been able to stop pulling at the seam.

The first: for almost any topic, the top AI systems now give him better answers than the world-class experts he could call on the phone. And he can call basically anyone. This isn’t a casual observation from someone without access — it’s a meaningful data point about what AI is actually doing to the value of expertise.

The second: the only real skill left in using AI is knowing what to ask. The models can already do almost anything you can describe in plain English. The bottleneck lives in your own head.

Hold those two claims next to each other. If the AI beats the experts, then the quality of your question only has to clear a low bar — good enough to unlock what the system already knows. You don’t need to ask like a cardiologist to get a cardiologist-quality answer. You just need to ask.

Except that’s not how it works in practice. And the gap between the two claims is where something important lives.

The better the question, the better the answer — even from a system that already knows more than any human alive. Expert-level interrogation of a superhuman system produces something qualitatively different from naive interrogation of the same system. The gap between a good question and a bad one doesn’t shrink because the underlying capability grows. It may widen. A sharper instrument in an unskilled hand doesn’t close the distance — it just makes the skilled hand more lethal.

What the AI has done is commoditize answers. What it has not done — cannot do — is commoditize the ability to know which question to ask.

There is a concept from epistemology that keeps surfacing here: the unknown unknown. Donald Rumsfeld made the phrase famous and then spent years living down the mockery, which was unfair, because the underlying idea is genuinely important. There are things you know you don’t know — the gaps you can name, the questions you can form. And there are things you don’t know you don’t know — the territory you can’t even see the edge of. The naive user of AI operates almost entirely in the second category. They ask what they already suspect. They get answers that confirm the shape of what they already believe. The system is brilliant and they are using it as a mirror.

The sophisticated user has learned to ask the AI to challenge their assumptions. To find the holes. To steelman the opposing view. To identify what’s missing from the framing. That second posture requires a kind of intellectual self-awareness — an ability to stand outside your own thinking and interrogate it — that is neither common nor easily taught.

Here is the uncomfortable implication: that self-awareness is not randomly distributed. It correlates with education, with reading, with having thought carefully about hard things for a long time. The people best positioned to ask good questions are, largely, the people who already had access to good answers through the old system. The gate moved. It didn’t disappear.

There’s a democratic story told about AI and I believe parts of it. The kid in rural South Dakota with a good question now gets an answer that rivals what the partner at McKinsey gets.

But access to information was never really the binding constraint. The binding constraint was always the ability to know what information you need — to feel the shape of your own ignorance precisely enough to ask for what fills it. That skill wasn’t distributed by the old system and it won’t be distributed by the new one. It has to be built, slowly, through years of reading and thinking and being wrong and trying again.

What AI may actually be doing is widening the gap between people who ask well and people who don’t — making the former dramatically more capable while leaving the latter approximately where they were, just with a faster way to get answers to questions they already knew to ask.

Somewhere right now, someone is sitting with the most capable thinking tool in human history, asking it to write a cover letter. The tool will do it beautifully. And the gap will quietly widen.

Categories
Probabilities

The Fiction of Certainty

There is a profound discomfort in the space between zero and one.

In her book Spies, Lies, and Algorithms, Amy B. Zegart notes a fundamental flaw in our cognitive architecture:

“Humans are atrocious at understanding probabilities.”

It is a sharp, unsparing observation, but it is not an insult. It is an evolutionary receipt. We are atrocious at probabilities because we were designed for causality, not calculus. On the savanna, if you heard a rustle in the tall grass, you didn’t perform a Bayesian analysis to determine the statistical likelihood of a lion versus the wind. You ran. The cost of a false positive was a wasted sprint; the cost of a false negative was death.

We are the descendants of the paranoid pattern-seekers. We survived because we treated possibilities as certainties.

The Binary Trap

Today, this ancient wiring misfires. We live in a world governed by complex systems, subtle variables, and sliding scales of risk. Yet, our brains still crave the binary. We want “Safe” or “Dangerous.” We want “Guilty” or “Innocent.” We want “It will rain” or “It will be sunny.”

When a meteorologist says there is a 30% chance of rain, and it rains, we scream that they were wrong. We feel betrayed. We forget that 30% is a very real number; it means that in three out of ten parallel universes, you got wet. We just happened to occupy one of the three.

Zegart operates in the world of intelligence—a misty domain of “moderate confidence” and “low likelihood assessments.” In that world, failing to grasp probability leads to catastrophic policy failures. But in our personal lives, it leads to a different kind of failure: the inability to find peace in uncertainty.

Stories > Statistics

We tell ourselves stories to bridge the gap. We prefer a terrifying narrative with a clear cause to a benign reality based on random chance. Stories have arcs; statistics have variance. Stories have heroes and villains; probabilities only have outcomes.

To accept that we are bad at probability is an act of intellectual humility. It forces us to pause when we feel that rush of certainty. It asks us to look at the rustling grass and admit, “I don’t know what that is,” and be okay with sitting in that discomfort.

We may never be good at understanding probabilities—our biology fights against it—but we can get better at forgiving the universe for being random.