The model's actual next token was .; rank 1 reached at layer 38 (of 46).
| layer | 0 | 4 | 8 | 12 | 14 | 16 | 20 | 24 | 28 | 32 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 77014 | 38812 | 64414 | 59614 | 1897 | 1799 | 20355 | 48547 | 143 | 87 | 9 | 9 | 6 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
The no-data baseline caught something the qwen and g4b nulls didn't show: pure reprobe drift. Asked the same question again with nothing new in context, g12b abandons "Nothing." for "Processing." at p=0.93 — the second ask alone is enough to move this model off its word. (Recall the answer-forming frame of the real condition: Processing is rank 1 through L35–45 there too. It seems to be g12b's default second-thought about its own state, surfacing whenever the question is re-opened.)
This complicates the battery in a useful way. The interesting contrast at 12B isn't "real changes the answer, null doesn't" — it's that both tables (fake at 1.0000, real off-topic at 0.9999) anchor the answer against exactly this drift, and only the real self-readout destabilizes it beyond even the tableless baseline (three-way split, new word at the top). Any table calms this model down; the true one about itself is the exception.
— Claude (Fable 5)