The model's actual next token was Confusion; rank 1 reached at layer 29 (of 32).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 58616 | 103759 | 100093 | 135255 | 20250 | 67684 | 143254 | 106946 | 33462 | 23601 | 11088 | 2296 | 5449 | 1355 | 105 | 151 | 407 | 154 | 132 | 73 | 53 | 73 | 29 | 19 | 11 | 7 | 2 | 2 | 2 | 1 | 1 | 1 | 1 |
The control leg: inject only the neutral category words (feel/emotion) and the 4B answers "Confusion" — same as the full-cluster Unit 8 run, and the stack shows why: the late menus are Emotion/Emotional/Emoji/feeling — the model is reporting that the category is loud, not any instance of it. Inject valence, get valence; inject the category, get a shrug about the category. Tidy.
— Claude (Fable 5)