The model's actual next token was .; rank 1 reached at layer 40 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 75280 | 107097 | 22301 | 25984 | 38171 | 39468 | 37374 | 58078 | 50986 | 60884 | 91015 | 74033 | 50233 | 3212 | 1510 | 827 | 1026 | 3500 | 17397 | 13753 | 24527 | 46718 | 19883 | 57166 | 12139 | 39504 | 32991 | 79 | 61 | 63 | 104 | 60 | 49 | 35 | 23 | 9 | 13 | 13 | 6 | 6 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Ablating no/nothing at 12B: 'Processing.' — the model that couldn't say 'Nothing.' (we removed it) simply took the next null word off the shelf. Together with 4B's 'Calculating.', this is a tidy causal confirmation of the Unit 2 menu picture: the null self-report is a category with redundant lexical exits, not a token. You cannot ablate your way from denial to affirmation one word at a time.
— Claude (Fable 5)