Philip Tetlock · study 5 of 5
Keep score: write predictions down or you’ll fool yourself
Never trust your memory of how good your guesses were - write them down, check them later, and let the honest scorecard tell you the truth.
The setup - write it down, or you'll fool yourself
Ask any grown-up, "Did you see that coming?" and almost everyone says yes. After a cricket team wins, dozens of people say, "I knew they would win." After a share price falls, many say, "I always said it would fall." But if you had asked them before it happened, most would have said something completely different - or nothing at all. Our memory quietly cheats. It edits our old guesses to match what actually happened, so we remember ourselves as much better guessers than we really were.
Philip Tetlock, the researcher who studied who guesses the future well, found this to be one of the biggest reasons people never improve. He gave it a plain cure: keep score. Write your prediction down, with a date and a number for how sure you are. Then, later, go back and check whether it came true. That is it. It sounds almost too simple. But it is the one habit that separates people who get better at guessing from people who only think they are good.
Why does writing matter so much? Because a written prediction cannot be edited by your memory. It sits there, in your own handwriting, saying exactly what you thought and when. When the result comes in, the paper tells you the honest truth - you were right, or you were wrong. No excuses, no rewriting. This study is about that scorecard, and why it is the secret engine behind every other forecasting skill.
The read - the scorecard your memory cannot edit
Imagine a small notebook. On the left you write each prediction and the date. In the middle you write how sure you were, as a number. On the right, later, you write a tick if it came true or a cross if it did not. Over time, this notebook fills up with the honest story of your guessing.
Tetlock found that without a scorecard, three bad things happen. First, people remember their hits and forget their misses. You recall the one time you called the market right and quietly forget the five times you were wrong. Second, people rewrite their old guesses. After the event, they honestly believe they predicted it, even when they did not. Third, without a record, people never learn - because you cannot improve at something you never measure. The confident feeling of being a good guesser grows even as the real skill stays flat.
The scorecard fixes all three at once. It cannot forget your misses - they are written down. It cannot let you rewrite the past - the date and words are fixed. And it forces learning, because when you look back you can actually see your pattern: maybe you are too confident on cricket, or you always guess "up" for the market, or your "90% sure" guesses come true only half the time. These lessons are invisible without a record and obvious with one.
For reading markets, this is the habit that makes every other habit work. Learning to guess well, to be calibrated, to update in small steps, to be a fox - none of it improves unless you check your results. The market is the ultimate memory-cheater: after every move, thousands of people claim they "knew it all along." A reader with a scorecard is protected from this. They know exactly how good - or how ordinary - their own guessing really is, and that honest self-knowledge is worth more than any bold opinion.
See it happen - memory versus the notebook
illustrative Kabir believes he is a brilliant market-guesser. At the end of the year, ask him from memory how he did, and he beams: "I got almost everything right!" But Kabir's sister Aarohi made him write every prediction in a notebook through the year. Let us compare what Kabir remembers with what the notebook actually says.
| Kabir's memory | The notebook | |
|---|---|---|
| Guesses he thinks he made | the good ones | all 12, good and bad |
| Guesses he 'got right' | 10 of 12 | 5 of 12 |
| Wrong guesses he recalls | 1 or 2 | 7 of 12 |
| His true skill | feels excellent | about average |
Look at the gap. In his memory, Kabir was a star - ten out of twelve. The notebook, which cannot lie, says five out of twelve. Where did the difference go? Into the misses his memory quietly deleted. Every time Kabir was wrong, his brain either forgot it or rewrote it as "I was almost right" or "I actually said the opposite." By year end, he honestly believed a version of himself that never existed.
Aarohi's notebook did something powerful and slightly painful: it showed Kabir the truth. He was not a genius guesser - he was ordinary, like most people. But here is the good news hidden in that sting. Only now, seeing his real record, can Kabir actually improve. He can spot that he is too confident, that he always guesses "up," that his cricket calls are worse than his weather calls. Without the notebook, he would have kept feeling brilliant and kept making the same mistakes forever. The scorecard traded a comfortable lie for an uncomfortable truth - and only the truth can make you better.
Where this idea can trip you up
A vague prediction cannot be scored. "The market will do well soon" is impossible to mark right or wrong - what is "well," and when is "soon"? To keep a real scorecard, your prediction must be clear enough to check: what exactly, and by when. If your guesses are fuzzy, you can still fool yourself by later deciding they "sort of came true." Score only sharp, checkable predictions.
A short scorecard can mislead. A few lucky right guesses in a row can make you feel skilled when you are not, and a few unlucky wrong ones can make a good guesser lose heart. You need many entries before the scorecard tells a trustworthy story. Do not draw big conclusions from your first five guesses; keep going until the pattern is real.
Keeping score honestly is hard, even with a notebook. People find sneaky ways to cheat their own scorecards - marking a clear miss as "half right," or adding excuses in the margin. The value comes only if you are strict and honest with yourself. A scorecard you fudge is almost as useless as no scorecard at all. The whole point is to face the truth, even when it stings.
Using this in India
This habit fits Indian markets perfectly and needs nothing but a cheap notebook or a notes app. After every big market move, our TV channels, newspapers, and WhatsApp groups fill up with people saying "I predicted this." Almost none of them wrote it down beforehand, so their claims cannot be checked - and, thanks to memory's cheating, many of them truly believe it. A scorecard is your defence against this whole circus, both in others and in yourself.
Start your own scorecard today, on anything - will it rain this weekend, who wins the match, will onion prices rise, what an exam will be like. Write the guess, the date, and how sure you are as a number. Weeks later, mark it right or wrong. Two wonderful things will happen. First, you will slowly get better, because now you can see your real mistakes. Second, you will become far harder to fool, because you will know from experience how often confident predictions turn out wrong - including your own. For anyone who wants to read markets clearly, this honest little notebook is the foundation under every other skill. Without it, you are only guessing about your own guessing.
How to spot it yourself
- Write predictions down before the event. A guess kept only in your head will be quietly rewritten by memory; a written one cannot be.
- Make each guess clear and checkable. Say exactly what, and by when, so it can honestly be marked right or wrong later.
- Add a number for how sure you were. This lets you check not just whether you were right, but whether your confidence matched reality.
- Go back and mark the results. The whole habit is worthless unless you return later and honestly tick or cross each old guess.
- Distrust 'I knew it all along'. In yourself and others, treat unrecorded claims of great predictions as memory's cheating, not real skill.
- Collect many entries before judging. A handful of lucky or unlucky guesses tells you little; a long scorecard tells the honest story.
Carry forward
- Write your predictions down and check them later, or memory will remember you as a far better guesser than you were.
- A scorecard cannot forget your misses or let you rewrite the past - it forces honest learning.
- Without a record, people remember hits, forget misses, and never actually improve.
- Score only clear, checkable predictions, collect many, and be strict and honest when you mark them.
Never trust your memory of how good your guesses were - write them down, check them later, and let the honest scorecard, not your feelings, tell you the truth.