The Two Witnesses

The Mystery

There is a curious thing memory can do to an experience: it can change the account we carry forward after the experience itself has finished.

A holiday full of delayed flights, tired children, wrong turns and forgettable afternoons somehow becomes "that was an amazing trip." A difficult period at work becomes "some of the best years of my life." A relationship containing years of warmth and companionship can have one painful ending cast its shadow backwards across everything that came before it. Sometimes the reverse happens instead - the frustrations fade, the arguments soften, the difficult days disappear, and what remains is a story we remember with affection.

We do this constantly, and what's curious is how easily we assume that the story we remember simply is the experience, filed away for later retrieval - as though life happens, memory records it, and we later open the file. But suppose that isn't quite what happens. 

The experience itself is fixed - we cannot go back and alter the moments we lived. But the version of those moments that survives - and the judgement we subsequently make about them - can be something rather different.

Then another question appears: when the two disagree, which one gets to decide whether it was worth having? And, perhaps more importantly, which one gets to decide what we do next?

This is the mystery.

The Pattern

Once I started looking, the distinction appeared everywhere.

Think back to a holiday you remember fondly. What actually remains? Probably not every breakfast, not each hour beside the pool, not the thirty-seven minutes waiting for the hire car, not Tuesday afternoon between lunch and dinner. Some moments have almost completely disappeared. Others remain remarkably vivid - the amazing view, the meal everyone still talks about, the moment something went badly wrong, the joke that became family folklore. A week containing thousands of individual moments becomes a handful of scenes.

Work seems to behave the same way. Someone looks back on building a company and says, "I loved those years." Perhaps they did. But the record may also contain sleepless nights, payroll worries, difficult customers and moments when they seriously considered giving up. Years later, the experience has acquired another shape: the first employee, the breakthrough customer, the eventual success. Whatever memory is doing, it does not appear to preserve every part of an experience equally.

And then we consult what remains when deciding what to do again. Would I return? Try it again? Start another company? Go back to that city? We rarely reconstruct every moment. We consult the story.

Which suggested a possibility I hadn't properly considered before: that the person who experiences an event and the person who later judges it may not be examining quite the same evidence. One weekend made that particularly difficult for me to ignore.

The First Clue

Some years ago, our family deliberately set out to create a memory. I'd been reading Daniel Kahneman and had become fascinated by the idea that certain moments seem to matter disproportionately in what we later remember, so rather than plan a long holiday, we tried something different - a short weekend designed around experiences we would remember. The centrepiece (regrettably my suggestion!) was a 300-foot bungee jump from a crane over a lake. Three of us agreed to do it.

Viewed from the distance of memory, the experiment worked spectacularly. We still talk about that weekend: the barge in Liverpool, the enormous crane at Tatton Park, my daughters jumping, the laughter afterwards, the strange mixture of relief, exhilaration and shared achievement. There was only one complication: we had to experience it first.

I tell the full story elsewhere, in A Study in Fear, but one moment is enough for this investigation. At the top of the crane, the instructor opened the gate and dropped the stabilising weight attached to my ankles over the edge. I felt the tug. My confidence disappeared. One thought arrived with remarkable clarity: is it too late to change my mind?

I jumped.

Some time later, safely back on the ground, terror had already begun its transformation into exhilaration, pride and story. Years later, ask me whether it was worth doing and my answer is immediate: absolutely.

Which leaves an interesting piece of evidence. The person remembering the jump is delighted to have done it. The person standing on the crane had serious reservations in the moment. Both are me. Both are describing the same event. Both appear to be telling the truth.

And that was the part of Kahneman's idea I had not really appreciated when I booked the weekend. I had deliberately designed an experience for the person who would later remember it. Standing on the crane, I encountered the interests of the person who actually had to live it.

So why were the two witnesses giving different testimony?

The full account of that morning is told in the Casebook story, A Study in Fear, if you'd like to follow that particular clue further.

The Working Theory

Kahneman proposed a distinction between what he called the Experiencing Self and the Remembering Self. The Experiencing Self lives life as it happens - this moment, then the next: pleasure, boredom, pain, curiosity, connection, anxiety, relief. The Remembering Self performs a different task: it looks backwards, evaluates what happened, constructs an account of the experience, and helps determine whether we would choose something similar again.

The distinction is not simply between experience and factual memory. I might remember perfectly well that I stood on a crane at Tatton Park. The more interesting question is how I subsequently evaluate the episode as a whole - was it good? was it terrible? was it worth it? would I do it again?

That made the bungee jump look rather different. One witness had to stand on the platform, hear the countdown and jump. The other received the episode afterwards: adventure, fear overcome, family experience, a memory worth keeping. 

Perhaps neither witness was mistaken. Perhaps they were simply answering different questions - one asking what is this like now?, the other what was that like? The questions sound almost identical. Kahneman's research suggests they are not.

Testing the Theory

The Cold Hand

In one experiment that Kahneman describes, participants placed a hand into painfully cold water. One trial lasted sixty seconds. In another, they experienced the same sixty seconds of painful cold, followed by a short additional period in which the water became slightly warmer - still unpleasant, just less so. From the perspective of the person living the experience, the calculation seems straightforward: the longer trial contains all the discomfort of the shorter one, plus more. Yet when participants were asked which experience they would prefer to repeat, many chose the longer trial. Something about its ending had altered the verdict.

The experiment gives us two particularly useful clues. The ending seems to matter disproportionately, while the additional duration - despite containing more discomfort - can carry surprisingly little weight in the later judgement.

Kahneman's wider work describes this family of effects through ideas including the peak-end rule: our remembered assessment of an experience can be disproportionately shaped by its most intense moments and by how it ends. Alongside it sits another clue, duration neglect - how long something lasted can matter surprisingly little to how we later evaluate it. The Remembering Self, it seems, does not simply add up every moment and produce a total. It forms a retrospective verdict according to rather different rules.

That would be curious enough. But another study reveals why it matters.

The Verdict Changes the Future

Kahneman and physician Donald Redelmeier studied patients undergoing colonoscopies, who reported their pain during the procedure and evaluated the experience afterwards. Again, the retrospective verdict was strongly influenced by the worst moments and by how the procedure ended. In a follow-up study, some procedures were extended briefly so they ended with a period that remained uncomfortable but was less painful than what had come immediately before. More discomfort had been added. Yet the experience was remembered more favourably - and those memories appeared to influence whether people returned for another procedure.

That moves the investigation forward. The remembering witness doesn't merely describe what happened. Its testimony can influence what happens next.

So perhaps the sequence is not quite as simple as experience becoming memory. The experience happens moment by moment. Some parts survive more strongly than others. Those surviving moments are assembled into a remembered account. That account receives a verdict. And the verdict becomes evidence for the next choice.

Experience becomes remembered evidence. Remembered evidence becomes a verdict. The verdict can shape choice.

Which raises an uncomfortable possibility: we may sometimes make tomorrow's decisions using not yesterday itself, but an edited account of yesterday. 

So far, we have seen this pattern in short, bounded experiences. But what happens when the thing being judged is not an episode, but a life? This is where the investigation widens.

A Whole Life

In one small experimental study, researchers asked people to consider the life of a fictional woman. In one version, she lived an extremely happy life. In another, she lived the same happy life, followed by additional years that remained pleasant, though somewhat less happy than those before. From the perspective of lived experience, the second life contains more - nothing good has been removed, and positive years have been added. Yet participants judging these hypothetical lives could rate the longer life less favourably. The later years changed the shape of the story.

There is an important distinction worth pausing on here. These people were not remembering their own lives - they were judging someone else's life from the outside. So this is not simply another demonstration of the Remembering Self. It is a different clue: it suggests that even when we step back and evaluate a life as a whole, narrative shape - including how the story ends - can influence the verdict we give it.

Now we are no longer asking only how someone evaluates sixty seconds of cold water. We are asking how human beings make judgements about a life. And suddenly the disagreement between the two witnesses becomes harder to dismiss as a quirk of memory. When we judge whether a life was good, what exactly are we judging - the moments, or the story they became?

Where It Returns Home

The two witnesses appear in far more ordinary places than a crane above a lake.

Consider work. Someone spends ten years building a company - long hours, uncertainty, friendships, arguments, cash-flow worries, breakthroughs, setbacks. Eventually it succeeds, and years later: "worth every minute." Perhaps it was. But the phrase is interesting, because it's spoken by the person who remembers the minutes, not the person who lived each one. That doesn't make the judgement wrong. It simply suggests another witness deserves to be heard: what were those minutes actually like?

Careers offer similar clues. A dramatic resignation may become the ending through which we remember an entire job. One difficult manager can sometimes come to dominate the story of five otherwise productive years. Or nostalgia may perform the reverse trick - the commute disappears, the frustrations fade, the old office becomes populated almost entirely by friendships and good stories, and memory offers its verdict: I should never have left. Perhaps. But what evidence has actually survived?

Relationships may reveal the same tension. A painful ending can reorganise years of affection and companionship around the final chapter. Memory can romanticise too - what once irritated us softens with distance, until we begin remembering not quite the relationship we experienced, but the one that survived the editing process.

I am not suggesting Kahneman's experiments prove that this is how every career or relationship is remembered. They do something more useful: they give us a clue worth looking for.

Parenting offers another version. People often say, "it goes so quickly." In memory, perhaps it does - years collapse into scenes: first days, birthdays, Christmas mornings, holidays, exam results, leaving home. The Remembering Self gets the chapters. The Experiencing Self lived every sentence: the breakfasts, the washing, the school runs, the tired evenings, the ordinary Tuesdays that never become photographs. Neither account contains the whole story.

And once you see that, a familiar phrase begins to sound different: "one day, it will all be worth it." We say it about businesses, qualifications, careers, projects, sacrifices. Sometimes we are right - many worthwhile things require discomfort. 

But there is another subtlety here. The voice making that promise is not yet the Remembering Self. It is us, in the present, imagining the judgement our future Remembering Self might one day make.

One day I’ll look back and be glad I did it. Perhaps. Which means we sometimes ask our present self to bear the cost for a story we hope our future self will value. That may be a perfectly good bargain. But perhaps it deserves investigating: who is making the promise, who has to pay, and how certain are we about the verdict?

What Changes Once You See It

I used to think the question was it worth it? required one answer. I am less certain now, because hidden inside it may be two questions: was it worth experiencing, and was it worth remembering? They overlap. But not completely.

The bungee jump is an easy example. Am I glad, looking back, that I did it? Yes. Did the person standing at the edge want to experience what came next? For several very clear moments, No. Both answers belong to the same event.

That doesn't mean a good life should be pleasant in every moment. Difficulty can become meaning. Fear can become pride. Effort can become accomplishment. Nor does attending to the Experiencing Self mean maximising comfort - a richly lived moment may contain effort, challenge, concentration, uncertainty, connection or even pain. The experiencing witness tells us about the quality of the life as it is lived, not merely whether it feels easy.

The Remembering Self is not a witness we should dismiss either. It gives continuity to episodes that would otherwise disappear into thousands of separate moments. It allows us to look backwards, evaluate, compare and construct the stories through which we understand what has happened to us. Perhaps that is also where the idea begins to reach beyond Kahneman's experiments and into a wider question of meaning: we do not merely remember events; we use remembered events to make sense of a life.

But the Experiencing Self has a claim too. It is the one who must live the life we are constructing. Perhaps the disagreement between the witnesses is not a problem to solve, but a tension to notice - and perhaps that is more interesting than trying to balance them according to some formula.

Because many apparently simple judgements may contain two different questions. "That was the best time of my life." Best in what sense? What did an ordinary Tuesday actually feel like? "The whole thing was terrible." Was the whole thing terrible - or has one part of the story come to dominate the verdict? "One day this will all be worth it." Worth it to whom - and judged from where?

Once the two witnesses become visible, I find it difficult not to hear them. The life we live and the life we remember are both ours. Perhaps the mistake is assuming that either witness, speaking alone, can deliver the verdict on the whole case.

Principle

The clues now sit together. The holiday reduced in memory to a handful of vivid moments. The company remembered through its eventual success. The bungee jump I am delighted to have done and, briefly, desperately did not want to do. The cold hand choosing more discomfort because the ending was kinder. The remembered medical procedure helping to shape a future choice. The hypothetical life judged partly by the shape of its final chapter.

Two witnesses. One life. Different evidence.

One witness lives the experience. Another later gives it a verdict. Neither alone is the whole case.

Continue the Investigation

Since noticing the two witnesses, I've started listening for them in ordinary decisions.

Sometimes they agree. The more interesting cases are where their testimony diverges: the impressive career that is exhausting to inhabit, the difficult adventure that becomes a treasured memory, the relationship whose ending rewrites its beginning.

I've become less certain that those disagreements need resolving.

Perhaps what matters first is simply noticing that both witnesses are there - and becoming a little more suspicious when one speaks as though it represents the whole experience.

A good ending can persuade me that every difficult moment was worthwhile. A painful ending can cast its shadow backwards and persuade me to reinterpret everything that came before it.

Neither account is necessarily false. But neither, on its own, contains the whole case.

Perhaps the task is not to decide which witness is right, but to resist allowing either of them to close the case alone.

And that leaves me with a question I suspect I'll keep returning to:

What part of my life might look different if the other witness were allowed to give evidence?

Investigator’s Notes

The principal witnesses and sources behind this investigation:

Daniel Kahneman, Thinking, Fast and Slow (2011).

https://www.penguin.co.uk/books/56314/thinking-fast-and-slow-by-kahneman-daniel/9780141033570

The distinction between the Experiencing Self and the Remembering Self, and the idea that the life we experience moment by moment may be judged differently when we later look back on it.

Kahneman, Fredrickson, Schreiber & Redelmeier (1993), “When More Pain Is Preferred to Less.”

https://www.psychologicalscience.org/journals/psychological-science/j.1467-9280.1993.tb00589.x

The cold-water experiment showing that people could prefer a longer unpleasant experience when its ending was less painful — an important clue behind the peak-end effect.

Fredrickson & Kahneman (1993), “Duration Neglect in Retrospective Evaluations of Affective Episodes.”

https://pubmed.ncbi.nlm.nih.gov/8355141/

Research showing that the duration of an experience can carry surprisingly little weight in how it is later remembered and judged.

Redelmeier & Kahneman (1996); Redelmeier, Katz & Kahneman (2003).

https://pubmed.ncbi.nlm.nih.gov/8857625/

https://pubmed.ncbi.nlm.nih.gov/12855328/

Studies of colonoscopy patients showing how the worst moments and the ending of an experience can shape later memory — and potentially influence whether people choose to undergo the experience again.

Diener, Wirtz & Oishi (2001), “End Effects of Rated Life Quality: The James Dean Effect.”

https://pubmed.ncbi.nlm.nih.gov/11340920/

A study showing that the ending of a hypothetical life can influence how that life is judged as a whole. This is not a study of personal memory, but provides a related clue about the influence of narrative shape on retrospective judgement.

Related Holmes UnLimited Story: A Study in Fear.

https://holmesunlimited.org/blog/a-study-in-fear

The family bungee-jump experiment that first made the difference between experiencing an event and later remembering it difficult for me to ignore.