What we're building, why it can work, and exactly where we are.
Prepared for the CEO & CFO · evidence gathered 5 June 2026 · external claims verified against primary sources · all LIFE results to date are from a synthetic test harness, not real users (see the status section).
Predict the user's reaction, then personalise around it
LIFE's teacher, Wisdom, takes an action every turn (a practice, a tone, a question). The predictive‑profiling programme builds a per‑user profile that predicts how that specific person will react — settle or get activated, accept or push back, complete or drop, return or churn — so Wisdom can adapt safely and so we can measure what actually helps.
1–9%
of the variance in real-life outcomes (work, health, relationships, income) is explained by the best psychometric predictor — meta-analyses cluster validity at r≈.1–.3. Static traits miss the moment.
+12.4%
online lift Meta reported by predicting a user's next action from their behaviour sequence — the same bet we're making.
159 / 160
experiments where an AI trained on real human choices out‑predicted purpose‑built models of the mind (Centaur, Nature 2025).
GO ✅
our measuring instrument passed its first milestone — on synthetic data. The real‑user readout is gated on three unblocks.
The strategic claim. The most valuable predictive companies in the world (Meta, TikTok/ByteDance) win by modelling each user's own behavioural history as a sequence and predicting the next action — not by leaning on static demographics or one‑time questionnaires. Decades of psychometrics show why: traits predict your average tendency, not how you'll respond right now. LIFE is making the same behaviour‑conditioned bet, in a domain (contemplative practice) where no one has yet measured it.
Where we are (honest). We have built and proven the measuring instrument: a rigorous, leak‑free eval that can tell a real predictive signal from a mirage. It correctly says GO when a signal is planted, NO‑GO when it isn't, and flags cheating. It has not yet been run on real LIFE users — that needs (1) authorised access to production data, (2) a consented cohort, and (3) a human labelling pass. Today's numbers prove the ruler works; they do not yet measure the building.
"Rich memory, narrow probes, brutal baselines, no spoilers." — the design discipline in one line.
02 — The gap we're attacking
Across the full scope of life outcomes, the best tests explain a minority of the variance
If a personality test or IQ score reliably told us how someone will behave, we wouldn't need this programme. The evidence — from decades of meta-analyses spanning work, school, physical health, mental health, relationships, wealth and wellbeing — says they don't. Here is the predictive validity (the correlation r, and the share of variance it explains, r²) of the best psychometric predictor in each domain, from the largest available meta-analyses.
School grades · IQ
r=.54 · 29%
Job performance · IQ
r=.31 · 10%
Job performance · Conscientiousness
r=.24 · 6%
University grades · Conscientiousness
r=.22 · 5%
Relationship satisfaction · Neuroticism
r=.22 · 5%
Divorce · low agreeableness
r=.18 · 3%
Depression onset · neuroticism (forecast)
r≈.15 · 2%
Income · Big Five
r≈.07 · <1%
Objective physical health · personality
r≈.03 · <1%
r = 00.250.50.751.0
Bar = predictive validity (r) on the full 0 → 1 scale; the green band marks the r ≈ 0.1–0.3 "ceiling" where most predictors sit (≈ 1–9% of variance explained). Even the best lands barely past halfway, and only IQ→grades clears the band — and it predicts the same skill it measures. Mortality (hazard ratios, not r) is shown in the table below.
Most r-values are "corrected" (operational) validities — the field's optimistic, measurement-adjusted estimates; the raw correlations you'd see in live data are typically lower still. †Mortality is reported as a hazard ratio per standard deviation (its native metric); the individual-level effect is small (rough r-equivalent < .10). IQ is the strongest psychometric mortality predictor — far larger than any personality trait.
By trait: the Big Five across outcomes
Drilling into personality specifically (since that's what a profile would carry): only Conscientiousness predicts across the board, and even it is weak. The average Big Five trait predicts job performance at just r ≈ .13 — near the floor of usefulness.
Trait
Job performance (ρ)
University grades (r)
Relationship satisfaction (r)
Where it matters most (best-evidenced role)
Conscientiousness
0.24
0.22
+0.12
The all-rounder — the only trait predicting performance across all jobs, the only Big Five trait independently predicting lower mortality (HR≈0.87), and the strongest correlate of healthy behaviour (Bogg & Roberts 2004).
Neuroticism
−0.13
−0.02
−0.22
The mental-health / wellbeing axis — strongest trait correlate of low wellbeing and of anxiety/depression (concurrent r≈.64; Kotov 2010), but only r≈.1–.2 as a forward predictor.
Agreeableness
0.10
0.07
+0.15
Relationship-leaning — up to ~.33 in healthcare roles; low agreeableness is among the better trait predictors of divorce (r≈.18).
Extraversion
0.11
−0.01
+0.06
Domain-specific — rises to ~.27–.33 for sales/management; second-strongest positive correlate of wellbeing.
Openness
0.10
0.12
≈0
Weakest / most context-specific — modest links to learning and creativity.
Job-performance ρ: Wilmot & Ones 2021 (corrected; "Emotional Stability +.13" shown here as Neuroticism −.13). University grades r: Poropat 2009 (corrected). Relationship satisfaction r: Malouff et al. 2010 (observed; own-trait → own satisfaction). Wellbeing/mortality roles summarised in the last column rather than tabulated, as those come from different metrics (multiple-R and hazard ratios).
The pattern is unmistakable. Outside one or two exceptions, psychometric predictors of real life outcomes cluster at r ≈ 0.10–0.30 — roughly 1–9% of the variance, leaving 90%+ unexplained (Roberts et al. 2007; replicated at ~¾ strength by Soto 2019). The canonical comparative review found personality, IQ and family background "indistinguishable" in their (modest) power to predict mortality, divorce and career attainment — a low ceiling shared by all the static predictors at once.
The two "big" numbers are not what they look like
IQ → school grades (r ≈ .54) is the genuine high point — but it largely predicts an outcome (graded tests) built from the same cognitive skills the IQ test measures.
Personality → wellbeing (~39% of variance; Steel et al. 2008) only reaches that height when you combine all five traits and predict a self-report (life satisfaction) from self-reports (personality) — shared method, an optimistic corrected ceiling, not a behavioural forecast.
Neuroticism → mental health looks enormous concurrently (r ≈ .64 for "who is anxious/depressed right now"; Kotov et al. 2010) but collapses to r ≈ .1–.2 as a forward predictor of who will become depressed, once you adjust for what you already know (Jeronimus et al. 2016, N = 443,313). The gap between "describes the present" and "predicts the future" is the whole game.
And the missing variance is real, not measurement noise
The natural objection — "the tests are just noisy" — is wrong, and that's the crux. IQ tests are among the most reliable instruments in psychology (test-retest ≈ 0.90–0.95). So the 90%+ they leave unexplained is genuine situational, in-the-moment variation. The landmark finding: 62–93% of the variability in how "conscientious" or "extraverted" someone actually behaves is within a single person — the same individual acting differently hour to hour — not between people. Fleeson, 2001/2007. A person differs from herself across occasions more than she differs from other people.
Measuring the trait is easy; predicting from it is the hard part. A machine can already infer your Big Five from your digital footprints about as accurately as your spouse can (r ≈ .56, beating the average friend; Youyou, Kosinski & Stillwell, PNAS 2015). But perfectly measuring the ruler does nothing to raise the ~0.10–0.30 ceiling on what the ruler predicts. What moves that needle is conditioning on behaviour in context — the premise of this programme, and the lesson Meta and TikTok already banked.
Intuition pump — r vs r² (the reality check)
A correlation r sounds impressive until you square it. r² is the fraction of the outcome the predictor actually accounts for; the rest is unexplained. Most psychometric validities live at r ≈ .1–.3 → r² ≈ 1–9%.
For LIFE: even a full battery — IQ (r≈.31 for work, .54 for grades) plus Conscientiousness (r≈.22) — tells us almost nothing about how this user reacts to a 10-minute body scan when they're tired tonight. A static "high-anxiety beginner" tag predicts their centre of gravity, not where the dial is in the moment — and the moment is 60–90% of the story.
IQ → job performance explains ~10% (r=.31). 90 of 100 squares are unexplained.
Conscientiousness explains ~5% (r=.22). 95 of 100 unexplained.
We are not claiming psychometrics are worthless — their aggregate effects rival those of socioeconomic status (Roberts et al., 2007), and they're genuinely useful for nudging priors across many people over long horizons. We're saying they are population-level actuarial instruments with a low ceiling, near-useless for calling one person's next reaction — so we complement stable traits with a behaviour-conditioned layer that targets exactly the in-the-moment variance they structurally cannot reach.
03 — What about meditation specifically?
In our own domain the static-trait story is even weaker — and the field is wide open
Narrowing from "life outcomes" to meditation, the honest headline is a null, and that is the most important finding: the best meta-analysis of who-benefits-from-meditation found that personality traits did not reliably moderate outcomes at all. The only robust baseline predictors were how distressed someone already was and how motivated they were — not their personality.
n.s.
personality as a predictor of who benefits from meditation — the only non-significant category in the best moderator meta-analysis (51 studies, n=7,782). Buric et al. 2022
~3.3%
of installers still active at day 30 across mental-health apps — the engagement cliff a profiling signal would have to move. Baumel et al. 2019
0
commercial meditation apps that have published a deployed predictive-personalization model on their own users. The whitespace is real.
Who benefits, who sticks — the evidence is thin and mostly null
Who benefits: personality was the only non-significant predictor category; the robust signals were baseline depression severity (r≈.22, → worse) and motivation (r≈.23, → better). Buric et al. 2022, Br. J. Health Psych. A few tiny RCTs (n=56) hint at personality×meditation-type matching, but they're too small to trust. Furnell et al. 2025
Who drops out: the largest attrition meta-analysis (114 studies, n=11,288) found essentially no baseline, demographic, or personality variable predicts who quits. Lam, Kirvin-Quamme & Goldberg 2022
The one modest real signal: Conscientiousness predicts home-practice adherence (β≈.21–.33, but explains only 13–24% of the variance, single n=96 study; Canby et al. 2021), consistent with Conscientiousness (r≈.32) and Neuroticism (r≈−.4) being the strongest trait correlates of dispositional mindfulness (Giluk 2009). These are correlations and small single studies — not a deployable predictor.
The engagement cliff — the commercial reality
Regardless of personality, meditation/mental-health apps shed almost all users fast: ~3.3% day-30 daily-active retention across 93 apps (Baumel et al. 2019); ~25–39% attrition even inside controlled trials (Linardon 2023); a Calm research cohort had ~42% still meditating by day 350 (Fowers et al. 2022). This is the number a behaviour-conditioned signal would need to move — and one nobody has published a fix for.
Median daily-active retention across 93 mental-health apps (Baumel et al. 2019). The cliff is near-universal and personality does not explain who falls off it.
Has Headspace, Calm or anyone else published this? No.
The published meditation-company science is overwhelmingly outcome RCTs ("does the app reduce stress/anxiety?"), heavily concentrated in Headspace. On the question that matters for us — has any company published a predictive model of meditation behaviour or a deployed personalization system on its own users — the answer is essentially no.
Company
Published outcome studies
Published predictive / personalization model on its users?
The only published "who-benefits" personalization model in the space (a Personalized Advantage Index, r²≈.10) is for the nonprofit Healthy Minds Program, not a commercial app. Webb et al. 2022
Read this as an unproven opportunity, not a validated edge. The whitespace cuts both ways: no competitor has published a predictive-personalization model on real meditators, so a working one would be genuinely novel — but the same literature shows prior attempts found weak-to-null trait→behaviour signal. The lesson is not "static personality tests will crack meditation engagement" (they won't), but that the field has never properly tried a behaviour-conditioned, continually-updated profile — which is exactly the bet this programme makes. We should expect value in the tail (cold-starts, the high-idiosyncrasy minority, the drop-off moment), treat it as a research bet, and measure honestly.
04 — The strategic precedent
How the world's best predictive companies actually do it
This isn't a speculative bet. The two companies with arguably the largest behavioural datasets on earth independently converged on the same answer: model the user's own action sequence and predict the next action; adapt fast from live behaviour.
Static featuresDLRM, 2019 — demographics + features → predict a click. "Who is this user?"
▸
Multi-task rankingpredict many engagement events at once, blend into one score. "What tends to engage?"
▸
Next action from the behaviour sequenceHSTU, 2024 — LLM-style scaling, 1.5T params, +12.4% online. "What does this user do next?"
Meta's documented progression — the winning move was modelling each user's own action sequence (the same mechanism as a language model predicting the next word); TikTok reached the same place via real-time behavioural adaptation. Zhai et al. 2024.
Meta — from static features to "Actions Speak Louder than Words"
Production ranking became multi‑task: one model predicts many engagement events at once — P(click), P(like), P(see‑less)… — blended into a single value score. Engineering at Meta, 2023.
2024 — the consequential shift: Meta's ICML paper "Actions Speak Louder than Words" recasts recommendation as predicting the next action from a user's behavioural sequence — the same mechanism as an LLM predicting the next word. It obeys LLM‑style scaling laws, reached 1.5 trillion parameters, and delivered a +12.4% lift in online A/B tests at a platform serving billions of users. Zhai et al., ICML 2024, arXiv:2402.17152.
The title is the thesis: a person's behaviour is a stronger signal than their stated attributes. (Note: the +12.4% is the real online business lift; a separate 65.8% figure in the paper is an offline benchmark — we keep those distinct.)
TikTok / ByteDance — predict from live behaviour, adapt by the minute
ByteDance's Monolith system is built for online learning: it refreshes the model from user feedback at minute‑level cadence, explicitly because user behaviour is non‑stationary ("concept drift") and recent behaviour predicts behaviour change better than stale models. Online training beat batch training in every case they evaluated. Liu et al., ByteDance, arXiv:2209.07663, RecSys 2022.
TikTok states publicly that the feed is driven primarily by behaviour — finishing a video matters a lot; follower count is "not a direct factor." Every interaction teaches the system your interests. TikTok Newsroom.
Careful scope: Monolith is ByteDance's training/serving infrastructure, not a published spec of the full "For You" ranker; the public scoring formula is a simplified internal explainer. The directional lesson is rock‑solid and on the record: behaviour beats declared preference, and fast adaptation wins.
The synthesis for LIFE. Both leaders moved from "who is this user (static)" to "what has this user done, in sequence, and what will they do next." That is precisely the predictive‑profile thesis — applied to a user's reactions to Wisdom instead of clicks and watch‑time.
05 — How predictable are people?
Behaviour is far more predictable than language — and the individual matters
~93%
theoretical ceiling on predicting where a person physically goes (mobility). Behaviour is highly regular. Song et al., Science 2010
~95%
of the predictable signal about a person is recoverable from their social ties alone — a stable profile carries most of it. Bagrow et al., 2019
~28–30%
of the time a human guesses the exact next word right. Language is hard — so predict actions, not words. Goldstein et al., 2022
Behaviour is far more predictable than language. So LIFE headlines behaviour (accept / complete / return) and reaction type — the high end — not the literal next words (the low end). Top two are theoretical ceilings (Song 2010); the bottom is observed human next-word accuracy (Goldstein 2022).
People are predictable where it counts. Human routine behaviour sits near a high predictability ceiling, and a stable model of a person captures most of the achievable signal — strong evidence that a persistent profile (not just the live conversation) carries real value. The newest and most direct result: Centaur, an AI fine‑tuned on ~10.7 million real human choices, out‑predicted bespoke scientific models of human cognition in 159 of 160 experiments on people it had never seen, and generalised to new tasks. Binz et al., Nature 2025. Conditioning on real individual behaviour has genuine headroom.
Intuition pump — ceiling vs. achieved (don't quote the ceiling as the result)
"93%" or "95%" are the maximum possible given how regular the behaviour is — the speed limit of the road, not the speed of today's car. A perfect model couldn't beat it; ours will capture some fraction of it.
For LIFE: if a user has meditated at 7am on 26 of the last 28 days, the structure to predict tomorrow's session is there. The honest statement is "behaviour like this has up to ~90% predictable structure, and our model currently captures X of it" — never "we predict users with 93% accuracy." It tells us the size of the prize.
Two honest caveats. These ceilings are for regular behaviour (where someone goes, whether they return); free‑form text is much less predictable, which is exactly why our headline targets are behaviour and reaction type, not the literal words. And the "95% from your social network" result is also a privacy red flag we take seriously: a platform could profile someone from their contacts even if they share nothing.
06 — The trap everyone hits
Persona collapse: sounding personal ≠ being personal
The obvious shortcut — "just ask a frontier model to be this user" — fails in a documented, measurable way. Asked to role‑play a specific person, today's best models collapse toward a generic, average persona: they flatten individual quirks and minority views, and resist deviating from their default voice.
On a benchmark of evolving individual preferences, several frontier models scored below random chance (one well‑known model at ~13.5% where chance is 20%) — they confidently predicted a stale, average preference. The best model reached only ~53%. HorizonBench, 2026; landscape review.
Independent work shows complete "persona collapse" on cognitive tasks for some frontier models, while others retain individual variation — it's model‑ and method‑dependent.Wang et al., Nature Machine Intelligence 2025; Santurkar et al., ICML 2023.
Human
~60%
Best model · Claude Opus 4.5
52.8%
Chance · 5-way choice
20%
A frontier model · an OpenAI model
13.5% ✗
0%accuracy predicting an individual's evolving preference →100%
Persona collapse, measured. On predicting a specific person's evolving preferences, several frontier models scored below chance — confidently guessing a stale, "average" preference. The fix is method (conditioning on real history), not a bigger model. HorizonBench, 2026.
The lesson is decisive for our roadmap: gains come from method and representation — conditioning on a person's real history — not from a bigger base model. A profile that reads beautifully ("Sarah, a cautious beginner who values gentleness") is worthless if swapping in a different user's profile predicts Sarah's reactions just as well. That failure is invisible to the eye and visible only to the right test — which is why we built one.
07 — Our approach & key decisions
Rich profile, narrow probes, brutal baselines
The design (reviewed independently, including by an external frontier model that caught three real flaws) rests on a few decisions that a non‑specialist can hold onto:
1 · Predict reactions, score against answer keys
Store a rich, evidence‑grounded profile (a "novel"), but score it against narrow, checkable targets (the "answer keys"). We never collapse a person into a flat label set — labels are disposable measuring instruments. "A label is a thermometer, not a tattoo."
2 · Aim at deeds, not words
A five‑level target ladder (Words → Deeds → Meaning → Felt outcome → Better choice). We headline behaviour (accept / complete / drop / return) and reaction type (settled / activated / pressured / trust) — not literal next words, which are near‑unpredictable.
3 · The validity test = "right person beats a similar wrong person"
The headline check is individuation: does the correct user's profile predict better than a deliberately similar but wrong user's profile? If they tie, we've collapsed and aren't really profiling anyone. This is our direct guard against persona collapse.
4 · Honest about cause
Phase A is prediction‑only, not proof that acting on the profile improves outcomes — logged data is confounded (Wisdom already gives gentler actions to distressed users). Using predictions to choose Wisdom's actions is a later, ethics‑gated phase with safe randomisation.
What we predict — and where we aim
L1Words — the literal next messagehard to predict · secondary
L2Deeds — observable behaviour: accept · complete · shorten · drop · return◀ we headline this
L3Meaning — reaction type: settled · activated · pressured · trust◀ we headline this
L4Felt outcome — a one-tap self-report check-incalibration anchor (later)
L5Better choice — would the profile pick a better safe action?the product goal (later)
Words → Deeds → Meaning → Felt outcome → Better choice. Language (L1) is near-unpredictable, so we aim at behaviour and reaction-type (L2/L3); felt-outcome and action-selection are deliberately later phases.
The testbed we've specified (built on tooling we already have)
To prove the approach on realistic, controllable users before touching production data, we'll extend the existing review UI ("Data Lab") into a persona‑driven testbed. As a reviewer works a conversation against a chosen persona, the profiler predicts the persona's next reaction; the prediction is logged and graded against the reviewer's human‑validated ground truth. Crucially this also produces four high‑value data products from one workflow: prompt/context‑engineering data for our agents, model‑training sets (long‑term), profiler labels, and Wisdom regression tests. Status: specified, not yet built; most of the infrastructure (personas, branching, model routing) already exists.
A subtle but essential discipline carries through: the persona's true disposition is the answer key used to generate ground truth — it is shown to the reviewer but never to the profiler, which must work only from the observable history. In production you never have the answer key; the whole point is recovering it from behaviour.
How it works, end to end (in the LIFE app)
Two coupled loops. A live loop runs inside the app on every message; an offline loop runs in the background between sessions to build and update the profile, which then feeds back into the live loop. Nothing changes for the user in Phase A — the profile is observed and scored, not yet used to steer Wisdom.
1Live conversation — inside the LIFE app, every message
User speaks or typespush-to-talk → speech-to-text, or text chat
Wisdom (Claude) repliesconditioned on recent turns + rolling summary + the user's profile
▸
User reactsaccepts · pushes back · shortens · completes · drops · returns
Each Wisdom action + the user's reaction is captured as one event ↓ (only data from before the moment; personalised references stripped — no spoilers)
2Offline — between sessions, on the background queue
EventizeAI action → user reaction, from the conversations + sessions log
▸
Label the reactionL2 behaviour (telemetry) · L3 reaction type (classifier bootstrap + human-validated)
▸
Profiler builds the profileevidence-grounded response patterns + cautions, versioned by date → stored in ai_user_notes
↺ The updated profile is loaded as Wisdom's context the next session — gated by the user's consent setting
Prediction & scoring — the harness
At each action the profiler predicts the reaction two ways — with the profile vs. a no-profile baseline — and we score the gap (bits saved · calibration · individuation). Phase A only observes and scores; the user's experience is unchanged. A later, ethics-gated phase would use the prediction to choose the better safe action (e.g. offer a 2-minute grounding instead of a 10-minute scan).
The same loop, worked through one exchange
A returning user with a profile that has learned two patterns: "reacts against directive tone" and "prefers short practices when drained."
Evening · the user has just said they're drained after work
Wisdom — candidate action
"Let's do a ten-minute body scan. Lie down and follow my lead, start at your feet…" ingredients: directive tone · 10 min · body focus
Profiler predicts — before the user replies
With this user's profile: likely feels pressured / asks for shorter (≈60%), affect negative. Flags: directive_tone_reactance, too_long.
→ bits saved; the "directive-tone reactance" pattern gains confidence in the profile.
In the live product (the later, ethics-gated phase) Wisdom would act on this — offering the 2-minute grounding it has learned this user completes when drained, in invitational language, instead of the 10-minute directive scan. In Phase A we simply prove we could have predicted the reaction.
08 — What we've built & proven
The measuring instrument works — proven on synthetic data
Read this first. Every number in this section comes from a synthetic generator with a known planted answer. It proves the measuring instrument is sound — it detects real signal, reports nothing when there's nothing, and catches cheating. It says nothing yet about real LIFE users.
We built the eval harness and ran it through a three‑way self‑test on data where we control the truth:
Test world
What we planted
Correct verdict
Result
signal
genuine per‑user individuality
detect it → GO
GO detected
null
nothing (users interchangeable)
report no signal
NO‑GO correct null
leak
a "cheating" shortcut
flag it
FLAGGED caught
On the signal world (120 users, 6,328 held‑out events), the headline results:
+0.063 bits
uncertainty removed per event vs. the strongest cheap shortcut (95% CI +0.051 to +0.074 — comfortably above zero). The binding "does it help?" number.
+0.186 bits
on novel actions Wisdom hadn't used with that user before — exactly where a lookup table fails and a real profile should win.
100%
of the 120 users where the correct profile beat a matched‑wrong one (individuation) — no persona collapse in the instrument.
0.040 → 0.015
calibration error before → after a standard correction — when it says "70%", reality lands within ~1.5 points.
User's own profile · T2
0.67
Strongest cheap baseline
0.71
Matched-wrong profile · control
1.37
0average log-loss — lower is better →1.4
Synthetic. Average surprise per event: the user's own profile (0.67) edges the strongest cheap baseline (0.71) and is far better than a matched-wrong profile (1.37, confidently wrong). The binding result is the gap to the baseline, not the gap to the wrong profile.
Stress‑tested. Five independent "skeptic" reviews tried to prove the GO was an artefact and found no blocking flaws; they independently confirmed the confidence intervals are honest (a naïve method would have badly overstated certainty), and caught and fixed a genuine "peeking at the future" bug in the data adapter. The leak audit confirmed the result was not explained by cheating (the edge was just as strong on ordinary events as on "spoiler" ones), and a deliberately‑rigged world confirmed the audit catches leakage when it's there.
One honesty note we insist on. We do not headline the eye‑catching "+1.0 bits" individuation figure — it's inflated because a wrong profile is confidently wrong, which the scoring punishes heavily. The figures we stand behind are the conservative own‑vs‑own number (+0.063 bits) and a fairness‑corrected individuation (~+0.40 bits).
09 — Stats decoder (plain English)
The five terms behind every number above
Bits saved
How much uncertainty the profile removes vs. a baseline, per event. One "bit" = one yes/no question's worth of uncertainty. It's our headline unit because it's comparable across everything we predict.
Rule of thumb: +0.06 bits/event is a small‑but‑real edge; +1 bit would be halving the uncertainty of a coin‑flip. Not a percentage — "+0.063 bits" is not "6% better."
Calibration / ECE
Are our stated probabilities honest? Take every time we said "~70%" and check it happened ~70% of the time. ECE rolls the gap into one number; 0 is perfect.
For LIFE: an accurate‑but‑over‑confident model is dangerous for decisions. We soften the probabilities and re‑check on a separate set of users so the model never "grades its own homework."
Baseline
The boring shortcut a profile must beat. Before crediting any fancy personalisation we ask: could a cheap lookup ("how did this user react to similar nudges before?") do as well? The profile only earns its keep against the strongest shortcut.
Why it matters: picking the toughest baseline makes a "win" conservative. A "NO‑GO" is a legitimate, expected outcome — and our instrument produces one when the shortcut is good enough.
Individuation
Is the profile really about this person, or just generically smart? Score the user with their own history, then with a similar wrong user's history. If the correct one wins, personalisation is genuine.
The point: this is the only honest test for persona collapse. A profile that sounds bespoke but loses this test is a generic template in disguise. We trust this number, never the prose.
Held‑out & leakage ("no peeking / no spoilers")
We only predict from what happened before the moment (a strict cut in time), and we audit that the answer didn't sneak into the inputs.
Spoiler example: if Wisdom's message name‑drops something only that user would say, predicting a warm reaction is cheating. We split results into "spoiler" vs "ordinary" events; if the edge lives only in spoilers, it's flagged as not real.
Log‑loss (the underlying scoreboard)
For each event we look only at the probability we gave to what actually happened, and we punish being confidently wrong far more than being unsure. Lower is better; every other metric is built from it.
In Phase A: the profile averaged 0.67 vs 1.37 for a wrong profile — the wrong profile was confidently wrong, which is exactly what log‑loss penalises hardest.
10 — Status, cost & risks
What it takes to get the real answer — and what could go wrong
The three unblocks between "instrument built" and "product‑validated"
Authorised production reads. The real data lives in production mental‑health records; our safety tooling correctly blocks ad‑hoc access. This needs an explicit, governed approval.
A consented cohort. Only users who have opted in to research data sharing — the lawful basis. The gate already exists in the data model.
A human labelling pass. Automated reaction labels are a useful proxy, not ground truth. A reviewer pass (which the testbed is designed to produce as a by‑product) is the gate to a trustworthy first readout. This is the main human‑time cost to scope; it doubles as training/eval data.
Material risks the board should hold.
Privacy / regulatory (highest). This is profiling on mental‑health data under GDPR; meditation can activate rather than soothe; the "you can be profiled from your network" result is a live concern. Any real run needs governance and consent up front, not as an afterthought.
Expected lift is small‑on‑average. The verified prior is that a profile's edge over a strong recent‑context baseline is single‑digit and shrinks as base models improve. The value is concentrated in the tail — cold starts, returns after a gap, novel actions, and a minority of high‑idiosyncrasy users — not a blanket accuracy jump. We should not promise the +0.186 novel‑action number as an average.
A frontier‑model architecture constraint. Anthropic's models expose no token‑level probabilities, so a true "perplexity" readout requires running an open‑weights model as a scoring backbone — a real (modest) infra/cost line for the production eval.
Persona collapse is the default failure. If we ever ship a profiler that hasn't passed the matched‑wrong test, it will sound personal and be generic. The test is mandatory, not optional.
What would change our mind (the NO‑GO criteria)
We've pre‑committed to killing or redesigning if, on real data: the profile's edge vanishes against the cheap per‑user baseline; a wrong profile predicts as well as the correct one (collapse); the lift comes only from "spoiler"/leakage events; or the profile improves engagement while worsening the wellbeing/activation‑risk signal. Stating these up front is what keeps the programme honest.
11 — Bottom line
The bet, the proof, and the ask
The bet: behaviour‑conditioned, continually‑updated profiles predict a person's reactions far better than static traits — the same bet Meta and TikTok validated at planetary scale — and in contemplative practice no one has measured it yet, so a clean result would be genuinely novel and defensible.
The proof so far: we've built and independently stress‑tested the measuring instrument and shown it is rigorous and honest — it detects real signal, reports a true null, and catches cheating — on synthetic data.
The ask: a governed green‑light for the real‑user readout — authorised access to a consented cohort plus a scoped human‑labelling pass — to convert "the ruler works" into "here's how predictable our users actually are, and where personalising will and won't help."
One‑line summary. We've proven we can measure predictive profiling honestly; the next step is a governed, consented run to find out how much real signal there is — expecting modest average lift with the value in the high‑lift tail, and treating privacy as a first‑class constraint throughout.