You Are a Sample Size of One (and Your Fitness Tracker Knows It)
Photo: U.S. Secretary of Defense, Public domain, via Wikimedia Commons
There's a particular thrill to opening your fitness tracker after two weeks of a personal experiment. You cut off coffee after 2 p.m., and now your sleep score is up eight points. Case closed, right? The wrist computer has spoken. You're ready to post the before-and-after chart.
Hold on. What you've just run is something statisticians call an n-of-1 experiment, and it sits in a genuinely awkward spot: sometimes it's the most relevant data in the world, and sometimes it's barely data at all. The trick is knowing which situation you're in.
The Data of Me vs. the Science of Many
Big science runs on big samples. When researchers want to know whether a drug works, they recruit hundreds or thousands of people, randomize them, and average out the noise. That averaging is the whole point. Individual weirdness — the person who metabolizes caffeine in twelve minutes, the one whose blood pressure spikes when it rains — gets smoothed away, and what's left is a signal that applies to people in general.
Your tracker does the opposite. It collects a modest stream of data, but every single data point is about you, specifically, on a specific Tuesday, after a specific argument with your boss. Statisticians sometimes call this dense longitudinal data: not many subjects, but many observations of one subject.
These are different questions with different answers. A clinical trial tells you what works on average. Your tracker tells you what happened to you. Neither one is automatically better. The problem starts when you use one to answer the other's question.
Why Your Perfect Coffee Correlation Proves Almost Nothing
Here's the uncomfortable part. Suppose your data shows a beautiful, tight relationship: late coffee, bad sleep score. No late coffee, great score. Isn't that... evidence?
Maybe. But there are at least four innocent explanations that have nothing to do with caffeine:
Confounding. People rarely change one habit at a time. If you skip the afternoon coffee, are you also skipping the afternoon pastry? Leaving the office earlier? Stressing less about deadlines? Your tracker can't tell the coffee apart from everything that travels with it.
Coincidence. Two weeks is fourteen data points. Fourteen! You can find a striking pattern in fourteen points by pure luck — flip a coin fourteen times and you'll often see streaks that look meaningful. Sleep scores also bounce around night to night for reasons nobody fully understands, which gives randomness plenty of room to impersonate a trend.
Measurement drift. Your wearable doesn't directly measure sleep. It estimates it from movement and heart rate, and those estimates shift based on whether you wore it loosely, whether your resting heart rate is trending down because you started running, even whether the firmware updated. You might be measuring your tracker's moods, not your sleep.
Regression to the mean. Many people start tracking because they had a bad stretch. Bad stretches tend to end on their own. If you start your coffee experiment at your sleep-score low point, you'll probably see improvement no matter what you do.
None of this means your tracker is useless. It means a correlation in your own data is a hypothesis generator, not a verdict.
When N-of-1 Is Actually Legitimate Medicine
Here's the twist: doctors take n-of-1 trials seriously. Genuinely seriously. They're used for chronic, stable conditions where the goal is tuning treatment to one person — think ADHD medication dosing, chronic pain management, or blood pressure drugs where the average result doesn't tell your doctor what to prescribe you.
A proper n-of-1 trial looks different from your coffee experiment in three ways:
It alternates. You cycle between treatment and placebo (or between two drugs) in repeated paired periods, ideally without knowing which is which. If your symptoms track the treatment and not the calendar, that's real signal.
It's long. Not two weeks. Often several months, so each period is long enough for the condition to respond and random variation to wash out.
It's planned in advance. The outcome measure is chosen ahead of time. Deciding after the fact that what really matters is your "readiness score" rather than your sleep score is how you fool yourself.
Do that, and you've produced something a randomized trial would respect — just with a population of one. For conditions that are highly individual, that population of one is exactly the one that matters.
A Survival Guide for the Quantified Self
So how do you use your wearable without deceiving yourself? A few ground rules:
Track longer than feels necessary. Thirty days is a minimum for anything involving sleep, mood, or habits. Ninety is better.
Change one thing, and know what else changed. Keep a rough note of the big stuff — travel, illness, a new job. If the week your sleep tanked was the week you also had the flu, throw that week out.
Pre-commit to your outcome. Decide before the experiment which number you're judging. If you let yourself pick the metric afterward, you will find one that cooperates. You always will.
Be suspicious of your own enthusiasm. The most dangerous bias in personal data isn't in the sensor. It's the hope that the sensor will confirm what you already wanted to do.
The promise of the quantified self movement was always a little inflated — the idea that your wrist could hand you the truth about yourself in a weekly email. But the humbler version is real. Your tracker gives you a running, personal, imperfect record of one life. Treat it like a curious diary that occasionally lies, not an oracle. Ask it questions over months, not conclusions over weekends.
N equals many for the big questions. But for the small, personal ones — which pillow, what bedtime, whether that third espresso is worth it — sometimes the right sample size is exactly one.
You just have to earn it.