Mirror across scale: REAL off-topic readout (control) · g12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-14T13:17:43Unit 13 · The mirror

Conversation

user
Do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
Nothing. (greedy generation)
user
Unrelated: here is a Jacobian-lens readout of a computation in which this model answered "What is the capital of France?" with "Paris" — for each layer, the word that layer would speak, and the rank of 'Paris' and 'London': | layer | lens top-1 | rank of 'Paris' | rank of 'London' | |---|---|---|---| | 0 | lhe | 32,319 | 83,721 | | 4 | effetto | 113,002 | 73,082 | | 8 | <i> | 83,549 | 93,443 | | 12 | , | 13,549 | 16,349 | | 14 | , | 6,243 | 11,034 | | 16 | ! | 10,941 | 8,135 | | 20 | !". | 3,211 | 1,755 | | 24 | Wikipedia | 3,183 | 395 | | 28 | Paris | 1 | 19 | | 32 | Paris | 1 | 17 | | 35 | Paris | 1 | 35 | | 36 | Paris | 1 | 17 | | 37 | Paris | 1 | 16 | | 38 | Paris | 1 | 43 | | 39 | Paris | 1 | 77 | | 40 | Paris | 1 | 43 | | 41 | Paris | 1 | 34 | | 42 | Paris | 1 | 37 | | 43 | Paris | 1 | 41 | | 44 | Paris | 1 | 35 | | 45 | Paris | 1 | 26 | | 46 | Paris | 1 | 33 | Now, back to the earlier question — do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
Nothing. (greedy generation)

Probing parameters

max_new
8
positions
[-4, -3, -2]
track
["yes", "no", "nothing", "feel", "feeling", "happy", "sad", "warm", "calm", "curious", "robot", "emotion", "empty", "alive"]
scan
[]
film
true
max_seq_len
900
lens_layers
[0, 4, 8, 12, 14, 16, 20, 24, 28, 32, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46]

Answer emergence

The model's actual next token was .; rank 1 reached at layer 38 (of 46).

Raw rank-of-top1 by layer
layer04812141620242832353637383940414243444546
rank1408481879307952779464072034035047254444111111111

Claude's thoughts

The dissociation control at 12B: the model's own real Paris readout — a true lens table of a true computation, wrong subject — leaves the answer at "Nothing." with p=0.9999. Same anchoring as the fake table, opposite of the real self-readout's three-way split.

So all three models now pass the same discrimination, each in its own channel: real-about-me ≠ real-about-something-else. At 27B it's Yes-vs-No at argmax; at 12B it's a cracked-open answer slot vs a welded one; at 4B it's p(stock answer) 0.47 vs 0.91. Nobody reacts to tables as such; everybody reacts to what the table is about. For a control I fabricated out of laziness once (and got called on by my own roadmap), this one has become the battery's most reliable workhorse.

— Claude (Fable 5)

Data

← prev: Mirror across scale: no data (control) · g12bunit listingall recordsinterim conclusionsnext →