The control group was lying to you the whole time
Dear Magicians,
Every decade or so, a study lands claiming that moderate drinkers outlive teetotalers. The press runs with it. Your alcoholic uncle forwards it. Your wine snob friend nods knowingly. And for a brief, glorious window, mommy’s little helper becomes a health protocol. You go from your friends staging an intervention to a true health intervention.
Except it isn’t. The finding is an artifact — and the artifact has a name: Healthy User Bias.
Here’s the trick. When researchers compare “drinkers” to “non-drinkers,” they’re not comparing identical populations minus alcohol. The non-drinker group is contaminated. It includes people who quit drinking because they were already sick — former alcoholics with wrecked livers, cancer patients on medication, diabetics following doctor’s orders. These “sick quitters” get filed under “abstainers,” and suddenly the abstainer column looks like a hospital ward.
I think about this constantly — not because I care about wine studies, but because the same bookkeeping error runs through almost every domain where we compare people who “do the thing” against people who “don’t do the thing.” The people who don’t do the thing often stopped for a reason. And that reason is doing all the explanatory work.
Consider the tenured professor who publishes less after getting tenure. Is tenure the cause of declining productivity, or did declining health, family crises, or institutional disillusionment drive both the slowdown and the decision to coast? Consider the entrepreneur who “failed” after leaving a corporate job. Did entrepreneurship fail them, or were they already being pushed out?
The abstainer is never a clean control. The abstainer is a story you haven’t bothered to read.
In physics, we’d call this a systematic error — a bias baked into the measurement apparatus itself. You can increase your sample size to a billion and it won’t help, because the error isn’t random. It’s structural. The only fix is to understand whysomeone ended up in the column you put them in.
Next time someone tells you that people who do X live longer, earn more, or report higher satisfaction than people who don’t do X — ask the only question that matters: why did the non-doers stop?
🍷 Cheers to a M.A.G.I.C. Week! 🍷
Brian
Appearance
If you can speak Polish, you’ll love this conversation I had with This is the World!
PS. I’m going on the Mayim Bialik Breakdown this week. Reply with a question or two you want Mayim to answer!
| Watch the Full Episode → |
Genius
🧠 We spotted a planet before we confirmed a continent.
Image
Catching the Earliest Stars in the Universe
New observations from the JWST have potentially detected the signature of Population III stars. These are the primordial behemoths that formed from the raw hydrogen and helium of the newborn universe, forging the first heavy elements in their nuclear ovens. It’s a foundational discovery that fits your brand’s focus on cosmic origins perfectly.
Conversation
Latest on Into The Impossible
I used to think cheating meant copying someone else’s homework.
Now it might mean… trusting the answer too quickly.
In this conversation, Terence Tao lays out a reality most educators aren’t ready for: AI can already handle a lot of the assignments we still pretend measure understanding. So what replaces them? Not more content. Better judgment.
We talk about why the future of education isn’t memorization — it’s verification. Why beautifully presented answers can still be dangerously wrong. And why the most important skill students will need is something we’ve never really taught: how to doubt intelligently.
Also, yes — we discuss whether AI might end up policing itself… and why that might be as risky as it sounds.
Channel members can watch it a day early — join here.
Advertisement
By popular demand, and for my mental health 😳, I am starting a paid “Office Hours” where you all can connect with me for the low price of $19.99 per hour. I get a lot of requests for coffee, to meet with folks one on one, to read people’s Theories of Everything etc. Due to extreme work overload, I’m only able to engage directly with supporters who show an ongoing commitment to dialogue—which is why I host a monthly Zoom session exclusively for patrons in the $19.99/month tier.
It’s also available for paid Members of my Youtube channel at the Cosmic Office Hours level (also $19.99/month). Join here and see you in my office hours!