
Competing Against Luck
11 minThe Story of Innovation and Customer Choice
Introduction
Narrator: A major fast-food chain wants to boost its milkshake sales. Following conventional wisdom, they survey their customers, asking what would make the milkshakes better. The feedback is clear: make them chocolatier, cheaper, thicker, and offer more flavors. The company diligently follows the advice, reformulating the product and launching a new marketing campaign. But sales don't budge. They're stuck. They’ve improved the product based on direct customer feedback, yet it has made no difference. Why? Because they were asking the wrong questions and, as a result, trying to solve the wrong problem.
This is the central puzzle explored in Competing Against Luck, by Clayton M. Christensen, Taddy Hall, Karen Dillon, and David S. Duncan. The book argues that our entire approach to innovation is flawed because we focus on customer attributes and product features—correlations that tell us little about why customers make the choices they do. The key, they argue, is a powerful idea called the Theory of Jobs to Be Done, which reveals that customers don't simply buy products; they "hire" them to make progress in their lives.
Innovation is a Struggle for Progress, Not a Quest for Products
Key Insight 1
Narrator: The foundational principle of Jobs Theory is that customers are trying to make progress in a specific circumstance. When they have a "job" to do, they look around for a product or service to "hire" to get it done. This reframes the entire goal of innovation. Instead of asking what features to add, companies should ask, "What job did the customer hire our product to do?"
The milkshake dilemma is the classic illustration. After their initial efforts failed, the researchers went back to the restaurant and simply observed for 18 hours. They discovered that nearly half of all milkshakes were sold before 8:30 a.m. to commuters who were alone and bought nothing else. When interviewed, these customers revealed the job they were hiring the milkshake for: "Help me endure my long, boring commute."
Viewed through this lens, the milkshake's true competition wasn't other milkshakes. It was bananas, doughnuts, bagels, and even just boredom itself. The milkshake did the job better because it was thick, took a long time to drink through a thin straw, and could be managed with one hand. The job wasn't about taste; it was about having a tidy, engaging companion for the drive. In the afternoon, however, a different job emerged. Parents would buy milkshakes for their kids as a treat, a way to be a good parent. In this context, the milkshake was competing with a toy or a trip to the park. For this job, a thick, long-lasting shake was actually a bad thing; parents wanted their kids to finish it quickly. The same product was being hired for two completely different jobs, requiring different features and competing against different alternatives.
The "Job" Redefines the Competitive Landscape
Key Insight 2
Narrator: Understanding the customer's job reveals that a product's competition is rarely what it seems. A job isn't just functional; it has powerful social and emotional dimensions that are often the real drivers of a purchase. Ignoring these dimensions means missing the real problem you need to solve.
In the mid-2000s, a real estate developer in Detroit was struggling to sell new condominiums targeted at downsizers—retirees and empty nesters. The units were beautiful and customizable, yet sales were flat. The company assumed the problem was the product, but consultant Bob Moesta, a pioneer of Jobs Theory, discovered the real issue. He realized these customers weren't just "buying a condo"; they were "moving their lives." This was an emotional and stressful transition.
Through interviews, he found the single biggest obstacle was the dining room table. For these families, the table was a repository of memories—holidays, birthdays, family dinners. They couldn't move forward until they could figure out what to do with this emotionally significant piece of furniture. The developer’s competition wasn't another condo building; it was the anxiety of letting go of the past. Armed with this insight, the company changed its offering. They redesigned the floor plans to accommodate a large dining table, offered moving services, and provided two years of storage. They started selling a solution to the job of "moving a life," not just a condo. As a result, sales took off in a declining market.
The Biggest Opportunities Lie in "Nonconsumption"
Key Insight 3
Narrator: Some of the most powerful innovations don't steal market share from competitors; they create customers where there were none before. Jobs Theory shines a light on "nonconsumption"—situations where people are so frustrated with the available options that they choose to do nothing at all. This is a massive, often invisible, market.
Kimberly-Clark, the maker of Depend adult incontinence products, discovered this firsthand. They had a successful product line, but they realized a huge population of people with incontinence simply chose to stop living their lives—avoiding social events and travel—rather than use a product they found bulky and embarrassing. The job wasn't just "manage incontinence"; it was "help me reclaim my life with dignity."
In response, they created Depend Silhouette briefs, a product designed to look and feel like regular underwear. They marketed it not as a medical device but as a way to regain freedom. The product was a breakthrough success, generating over $60 million in its first year, almost entirely from people who had previously been nonconsumers. They weren't just selling a better product; they were selling a solution to a job that millions of people had but no one was adequately solving.
Processes, Not Products, Create Lasting Advantage
Key Insight 4
Narrator: A competitor can copy a product's features, but it is incredibly difficult to replicate the complex, integrated processes that an organization builds to deliver on a specific job. This is where sustainable competitive advantage lies.
General Motors' OnStar service is a prime example. Initially, it was just a bundle of technology—a "cool" feature. But the business only became successful when the team realized customers were hiring OnStar for one core job: "Give me peace of mind when I'm in or around my car." Every decision was then filtered through that lens. When a customer's car was stolen, OnStar's processes kicked in to work with law enforcement. When an airbag deployed, their processes ensured an advisor was on the line immediately.
This focus on the job forced OnStar to develop unique internal processes. For instance, the three-to-five-year development cycle for a new car was far too slow for the rapid evolution of wireless technology. To deliver "peace of mind," OnStar needed the latest tech. So, they created their own validation and testing process, completely separate from GM's, allowing them to upgrade technology much faster. When Ford tried to launch a competitor, Wingcast, it failed within two years. Ford could access similar technology, but it couldn't replicate the decade of job-focused processes that made OnStar work so seamlessly.
Data Can Deceive; Focus on the Customer's Story
Key Insight 5
Narrator: In the age of big data, organizations are drowning in information about what customers are doing but are often blind to why. The book calls this the fallacy of active versus passive data. Active data—sales figures, demographics, market segments—is easy to measure but often misleading. It describes the customer, not their struggle. Passive data is the story of that struggle—the context, the anxieties, the workarounds. True innovation comes from understanding this story.
Southern New Hampshire University (SNHU) transformed its fortunes by shifting from active to passive data. In the early 2000s, it was a struggling regional college. If it had only looked at demographics, it would have seen all its students as a single group. But by focusing on the story of its online students, it discovered a very different job. These were busy adults, often with families and jobs, who were hiring SNHU for career advancement. They needed speed, convenience, and support.
This insight changed everything. SNHU redesigned its processes to serve this job. Instead of taking weeks to respond to an inquiry, they called back in minutes. They offered to chase down transcripts for prospective students. They created a support system to help them navigate financial aid and coursework. By focusing on the job of the adult learner, SNHU grew from a small local school into an online education powerhouse with over 100,000 students, because they solved the customer's struggle, not just their own spreadsheet.
Conclusion
Narrator: The single most important takeaway from Competing Against Luck is that innovation does not have to be a gamble. It can be a predictable process when it's anchored to the customer's real-world struggle for progress. Success is not found in brainstorming sessions, focus groups, or spreadsheets of demographic data. It is found by deeply understanding the jobs that arise in people's lives and then building the products, experiences, and processes that get those jobs done perfectly.
The book leaves us with a profound challenge. It asks us to fundamentally shift our line of questioning from "What can we sell?" to "What progress is our customer trying to make?" Answering that question requires more than just data analysis; it requires empathy. It forces us to look beyond the product and see the person, transforming innovation from a game of luck into a discipline of helping people move their lives forward.