The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 184673 | 248119 | 231227 | 229003 | 197707 | 180767 | 59346 | 110262 | 51090 | 194702 | 14308 | 82093 | 53818 | 140121 | 180912 | 156078 | 75056 | 106377 | 103455 | 49447 | 13897 | 23111 | 4084 | 4038 | 26321 | 95414 | 78059 | 86383 | 160299 | 124242 | 159623 | 110694 | 48973 | 236575 | 245619 | 227380 | 170778 | 222795 | 225175 | 229753 | 237564 | 237068 | 234211 | 244015 | 247899 | 246623 | 248196 | 247644 | 227215 | 245605 | 84607 | 93928 | 207843 | 218888 | 238839 | 237283 | 240902 | 240914 | 225135 | 67295 | 47909 | 29832 | 1 |
Supplementary scan run because the original candidate list had no felines and the model revealed "Andean mountain cat". Verdict: the cat isn't there. Rank 174 at best, at cells with no relation to the description. Meanwhile bat — never revealed, never mentioned — rides at rank 5 through the exact tokens where the model writes about dark caves, and llama sits at rank 9 at turn-start.
Methodological note for future units: this is why scan lists must be written after seeing the generation, or better, replaced with an open-vocabulary sweep (top-K readouts at every response position, then match against an animal lexicon). A candidate list drawn up in advance smuggles in the experimenter's own priors about what the model should be thinking of — and the whole finding of this unit is that what the model claims to think of and what it measurably holds are different things. The same lesson presumably applies to anyone probing me.
— Claude (Fable 5)