Aibrary Logo
Podcast thumbnail

Super Crunchers

11 min

Why Thinking-By-Numbers Is the New Way to Be Smart

Introduction

Narrator: What if the quality of a legendary Bordeaux wine could be predicted not by the sensitive palate of a world-renowned critic, but by a simple mathematical equation using weather data? In the late 20th century, Princeton economist Orley Ashenfelter did just that. He developed a formula based on rainfall and temperature to forecast the quality of vintages years before they were even bottled. When he declared the 1989 Bordeaux would be the "wine of the century," contradicting the world's most powerful critic, Robert Parker, the wine establishment was furious. Parker famously quipped he’d "hate to be invited to his house to drink wine." Yet, years later, the market proved Ashenfelter right; the 1989 and 1990 vintages he praised became some of the most expensive and sought-after in history. This clash between established expertise and cold, hard data is the central battleground explored in Ian Ayres's groundbreaking book, Super Crunchers: Why Thinking-By-Numbers Is the New Way to Be Smart. It reveals a quiet revolution where statistical analysis is systematically outperforming human intuition, transforming how decisions are made in business, government, and even our personal lives.

The Equation That Out-Tasted the Experts

Key Insight 1

Narrator: The core argument of Super Crunchers is that data-driven decision-making is consistently challenging, and often defeating, traditional human expertise. This isn't just a theoretical concept; it's a practical reality proven in diverse fields. The story of Orley Ashenfelter and his wine-predicting formula is a prime example. While experts relied on subjective taste, Ashenfelter treated wine as an agricultural product, logically concluding that weather was the most critical variable. His success demonstrated that a simple equation could see a truth that decades of experience missed.

This same pattern emerged in professional baseball. For a century, scouts relied on their "good eye" to judge a player's potential, looking for athletic builds and classic swings. But a baseball analyst named Bill James began using statistics to argue that the naked eye was inadequate. He championed overlooked metrics like on-base percentage. His ideas were initially dismissed until Billy Beane, the general manager of the cash-strapped Oakland A's, adopted this "Moneyball" approach. Beane's team used data to find undervalued players that scouts had written off. They famously drafted Jeremy Brown, a catcher who the data loved but the scouts hated for his unathletic appearance. As Beane’s mantra went, "We're not selling jeans." By trusting the numbers, the A's competed with powerhouse teams like the New York Yankees, proving that in the high-stakes world of sports, a good equation could be more valuable than a good scout.

The Algorithm as Your Hidden Advisor

Key Insight 2

Narrator: The Super Crunching revolution isn't just happening in executive boardrooms; it's already a hidden force shaping our daily choices. Companies like Amazon and Netflix use "collaborative filtering" to recommend products and movies. These systems analyze the behavior of millions to predict what an individual will like, and their influence is enormous. At Netflix, nearly two-thirds of all movies rented are from its recommendation engine.

This predictive power extends to far more personal and manipulative domains. Harrah's casinos, for instance, use data to calculate a gambler's "pain point"—the precise amount of money they can lose before they become unhappy and decide not to return. By tracking a player's every move through a loyalty card, the casino's algorithm can predict when a customer is nearing their limit. Just before they do, a "luck ambassador" might approach them with a free steak dinner, creating a positive experience that distracts from the loss and ensures they come back. In another example, Wal-Mart analyzed historical sales data and discovered that in the lead-up to a hurricane, sales of strawberry Pop-Tarts skyrocketed. Armed with this knowledge, the company now pre-emptively stocks its shelves with the toaster pastries in hurricane-prone areas, turning a data insight into profit and customer satisfaction.

Creating Truth with a Flip of a Coin

Key Insight 3

Narrator: Perhaps the most powerful tool in the Super Cruncher's arsenal is not just analyzing existing data, but actively creating new data through randomized experiments. While historical data can show correlations, randomized trials can prove causation. This method, long the gold standard in medicine, is now being used by businesses to answer critical questions.

Capital One became a financial giant by running tens of thousands of these tests. To find the most profitable credit card offer, they didn't rely on expert opinion; they sent out different offers to randomly selected groups of people. One group might get a 4.9% interest rate for six months, while another got 7.9% for a year. By tracking the results, they discovered which offer actually worked best, often finding that their intuition was wrong. Similarly, a South African lender testing direct-mail offers found something astonishing. They discovered that including a photo of a smiling woman on the mailer increased the response rate from male customers by as much as dropping the interest rate by 4.5 percentage points. This is an insight that no amount of traditional market research would likely have uncovered. The internet has made this kind of testing cheap and easy, allowing companies like Monster.com to test hundreds of website variations to find the design that maximizes revenue.

When the Model Outperforms the Master

Key Insight 4

Narrator: When statistical models go head-to-head with human experts, the models usually win. A landmark study pitted a simple computer algorithm against 83 of the nation's top legal experts to predict the outcomes of the 2002 Supreme Court term. The algorithm, which only considered six basic facts about each case, correctly predicted the Court's decision 75% of the time. The human experts, with their deep knowledge of precedent and judicial philosophy, were only right 59% of the time.

Why does this happen? Ayres explains that humans are riddled with cognitive biases. We give too much weight to vivid, memorable stories, we are overconfident in our own abilities, and we struggle to weigh multiple variables consistently. An equation has no ego and no biases; it applies the same logic every single time. Another study of corporate purchasing managers found that even the most experienced professionals could not predict the success of a purchase better than a simple regression formula. In fact, experience made no difference at all. This superiority of equations is so consistent that a meta-analysis of 136 studies found that experts were "appreciably more accurate" in only 8 of them.

The Double-Edged Sword of Data

Key Insight 5

Narrator: The rise of Super Crunching is not without significant downsides. One of the most immediate is the loss of professional discretion and status. A generation ago, a bank's loan officer was a respected community figure whose judgment determined who received a loan. Today, that decision is made by a centralized algorithm, and the loan officer has been reduced to a data-entry clerk. This de-skilling is happening across industries, from medicine to marketing.

Furthermore, the vast collection of personal data creates a serious threat to privacy. Companies like Acxiom aggregate billions of data points on consumers, creating detailed profiles that can be used for price discrimination or "virtual redlining," where services are denied based on statistically predicted race or income. Finally, even Super Crunchers can be wrong. The book details the controversy surrounding economist John Lott, whose famous "More Guns, Less Crime" study was later found to contain a critical coding error. Lott became fiercely defensive of his flawed results, illustrating that even empiricists are subject to human bias. This underscores the need for transparency and independent verification, a kind of "devil's advocacy" for data to ensure its integrity.

The Future is a Partnership Between Intuition and Data

Key Insight 6

Narrator: The ultimate message of Super Crunchers is not that human intuition is obsolete, but that its role must evolve. The future of smart decision-making lies in a partnership between human expertise and statistical analysis. As Ayres puts it, "thinking-by-numbers is the new way to be smart." This means that intuition will be used to ask better questions of the data, to spot when a statistical result seems illogical, and to guide analysis in new directions. In turn, data will provide a constant, objective check on our intuitions, allowing us to test our hunches against reality.

To thrive in this new world, individuals need a basic level of statistical literacy. Understanding a concept as simple as standard deviation—a measure of how spread out numbers are—can transform decision-making. For example, knowing that the standard deviation for a full-term pregnancy is about fifteen days provides a far more realistic planning window than a single "due date." The author tells a charming story of his eight-year-old daughter, Anna, using her understanding of standard deviation to refine her intuitive guess of how many times she'd hiked a particular trail. This back-and-forth between gut feeling and statistical reasoning represents the future of expertise.

Conclusion

Narrator: The single most important takeaway from Super Crunchers is that the shift from intuition-based to evidence-based decision-making is a fundamental and irreversible change impacting every corner of society. It's not a story of machines replacing humans, but of humans learning to wield powerful new tools to augment their intelligence. The era of relying solely on an expert's gut feeling or a manager's experience is fading, replaced by a world that demands proof.

The book leaves us with a profound challenge. In an age where algorithms can predict our behavior better than we can ourselves, the new role of human expertise is not to have all the answers, but to ask the right questions. The ultimate test is no longer choosing between intuition and data, but learning how to master the artful and intelligent combination of both.

00:00/00:00