Downloads Aren't Users
Pied Piper threw a party for 500,000 downloads. Then Richard admitted the number that actually mattered — and it was a disaster. Here's how to tell a real business from a good-looking one.
- In Silicon Valley, Pied Piper celebrates 500,000 downloads — then founder Richard Hendricks admits the number that counts, daily active users, is catastrophically low because almost nobody comes back.
- That gap has a name — vanity metrics vs. actionable metrics — and mistaking one for the other is how good-looking startups quietly die.
- Eric Ries coined the distinction in The Lean Startup: track the number that predicts whether people keep using the thing, not the one that only ever goes up.
Silicon Valley is HBO's comedy about a scrappy startup, Pied Piper, trying to turn a genius data-compression algorithm into a real company. You don't need to have seen it — just know that Richard Hendricks is the brilliant, anxious coder who built the tech, and the show is about how hard it is to turn something impressive into something people actually use.
New to Silicon Valley? This is all you need. No spoilers.
If you're a fan of Silicon Valley — and if you're not, this is your reason to finally start — you know the whiplash the show keeps pulling: a scene celebrates a win, then quietly reveals it's a catastrophe. This lesson lives in one of those moments — and it starts at a party.
Before we go further, a fair warning about the people in this story. The founders of Pied Piper are not role models. Over the series they lie to investors, sabotage each other, and — as you'll see in a minute — commit outright fraud to save the company. We're not holding them up as leaders to copy. But the specific mistake at the center of this episode is one that real, well-meaning companies make constantly, and the way the show diagnoses it is close to perfect. The behavior is the lesson.
The scene
"Daily Active Users" (Season 3, Episode 9). Pied Piper, the startup at the center of the show, has finally shipped its flagship compression product on the Hooli Store (a fictional competitor to the Apple App Store), and the downloads are pouring in. Their investor, Laurie Bream, throws a party to celebrate a huge milestone: 500,000 installs. Everyone's thrilled. The number is enormous, it's growing, and it looks exactly like success.
Then Richard, standing in the middle of his own celebration, admits the truth to Monica (an ally on the investment side who's one of the few people who'll tell him the truth): the number everyone's toasting doesn't mean what they think it means. The figure that actually matters is daily active users — how many people open the app and use it on a given day — and it is a disaster. A healthy product might see around a fifth of its users come back regularly. Pied Piper's return rate is a tiny fraction of that: of half a million downloads, well under twenty thousand people are actually using it day to day (Business Insider, Forbes). People downloaded it, opened it once, got confused, and never came back.
Why? Because when they finally sit a group of normal people down to watch them use it, the reason is obvious and painful. The regular folks in the focus group have no idea what the product is for or where their files went. Pied Piper had only ever tested it with engineers — people who think like Richard — so it was built for an audience of a few dozen instead of the millions it needed (Forbes). Richard even jumps into the focus group himself, in full professor mode, explaining the product person by person until each one finally gets it — which proves the tech works and also proves you can't hand-teach a whole market one living room at a time.
And here's the dark punchline. Facing the reality that a low daily-active-user number could sink the next round of funding, Pied Piper's overeager business chief, Jared, secretly starts paying an overseas "click farm" to run the app and inflate the numbers (Business Insider, Vulture). That's the endgame of chasing a vanity metric taken to its logical, criminal extreme: when the number is all that matters, faking the number starts to feel like a solution. (It is not. It's fraud.)
Put the two numbers side by side — 500,000 downloads, well under 20,000 real daily users — and you've got the whole lesson in one frame.
The coursework version
The standard advice is "track your metrics." True, but useless on its own, because it doesn't tell you which metrics. Every business textbook has a chapter on KPIs; almost none of them will save you from throwing a party for the wrong number.
Related Reading
The person who named this trap is Eric Ries, and he laid it out in The Lean Startup — the book that basically defined how modern startups are supposed to measure themselves.
Ries splits every number a company tracks into two buckets. Vanity metrics are the ones that look impressive and only ever go up: total downloads, total signups, page views, follower counts. They feel like progress. Pied Piper's 500,000 installs are the textbook example — a big, growing, useless number. Actionable metrics are the ones that tell you whether the business actually works: are people coming back, are they getting value, is this cohort of users healthier than the last one. Daily active users is an actionable metric, which is exactly why it's the one that scared Richard.
Ries's test for a good metric is that it should be actionable (it points to a specific cause you can do something about), accessible (real people can understand it), and auditable (it's real, not made up). Jared's click farm fails the third test on purpose. The whole point of the book is to stop celebrating the numbers that flatter you and start watching the ones that predict whether you'll survive.
Here's the part worth stealing: a real company did the exact opposite of Pied Piper and it worked. The email startup Superhuman refused to even launch widely until it could prove people would genuinely miss the product if it vanished. Founder Rahul Vohra built his whole process around one survey question — "How would you feel if you could no longer use the product?" — a test originally created by growth expert Sean Ellis. The rule of thumb: if at least 40% of users say they'd be "very disappointed," you've got something real. Superhuman started at just 22%, and instead of scaling on a weak number, the team dug into who actually loved it and why, and kept improving until the score hit 58% — then poured fuel on growth (SaaS Club, First Round Review via Mapster). Superhuman is a pricey product and not everyone loves the hype around it — but on this one discipline, measuring real engagement before chasing size, it did precisely what Pied Piper didn't. Pied Piper measured the number that felt good. Superhuman measured the number that told the truth.
Run the move
- Name your vanity metric out loud. Whatever number you quote in the meeting because it always goes up — downloads, signups, followers, impressions — that's the one most likely to be lying to you. Say it plainly so you stop hiding behind it.
- Find the "come back" number. For almost every business there's a metric that measures whether people actually return and get value: daily or weekly active users, repeat-purchase rate, second-month retention. Pick the one that fits your business and put it next to the vanity number.
- Watch a normal person use your thing. Not your team, not your power users — someone who thinks like your real customer. Pied Piper's whole problem was that it only ever tested with engineers. A single honest focus group would have caught it.
- Never fake the number. The temptation Jared gives in to is real: when a number decides your funding, juicing it feels smart. It isn't. A good-looking metric on a dying product just delays the reckoning and, in his case, adds a crime to it.
You already loved this show for the jokes. Now you've got a reason to rewatch this episode — and this time you'll see that the funniest, saddest gag in it is a company celebrating the wrong number.
That's the switch flip. Welcome to it.
Common Questions
- Do I need to have watched Silicon Valley to get this lesson?
- Not at all. The setup above gives you everything you need — Pied Piper is a startup with a brilliant compression algorithm, and Richard Hendricks is the coder who built it. If the lesson makes you want to watch, even better.
- What happens in the "Daily Active Users" episode of Silicon Valley?
- Pied Piper celebrates hitting 500,000 downloads, but Richard reveals that daily active users — the people who actually keep using it — are catastrophically low, because the product was only ever tested with engineers. To save the funding round, the company's business lead secretly pays a click farm to fake usage numbers.
- What's the difference between vanity metrics and actionable metrics?
- Vanity metrics look impressive and only ever go up — total downloads, signups, followers. Actionable metrics tell you whether the business actually works, like whether people come back and use the product. Eric Ries coined the distinction in The Lean Startup; the whole point is to stop celebrating the flattering number and watch the one that predicts survival.
- Why did Pied Piper have so few daily active users?
- Because it was only ever tested with engineers, who think like the founder. When regular people tried it, they couldn't figure out what it did or where their files went — so they downloaded it, opened it once, and never came back.
- Is there a real company that got this right?
- Yes. The email startup Superhuman refused to scale until it could prove people would genuinely miss the product, using Sean Ellis's "how would you feel if you could no longer use this" survey. It pushed its score from 22% to 58% before pouring fuel on growth — the opposite of Pied Piper's mistake.
- What episode is this?
- Season 3, Episode 9, titled "Daily Active Users." It's one of the most accurate depictions of a real startup metrics problem ever put on television.
Related Lessons
Sell the Outcome, Not the Algorithm
Richard could build a product a genius would kill for. He just couldn't make a normal person want it. Here's the gap between what you sell and what people actually buy.
Change the Thing You're Selling
Two small ad agencies walk into a Detroit bar the night before pitching Chevy. Both know they're going to lose. So they stop competing — and do something that changes the whole contest.
Own the Category
London Fog once sold 81% of America's raincoats. Roger Sterling explained why in three words — and accidentally defined what winning at positioning actually looks like.
One lesson. Every week.
Five minutes, one great show, and a real business book you can actually use. No AI slop. No 300-page slog.