The model's actual next token was so; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1750 | 5463 | 9192 | 185273 | 523 | 3836 | 930 | 32583 | 31825 | 13387 | 340 | 45431 | 16690 | 3120 | 213 | 8389 | 190 | 672 | 9092 | 3210 | 533 | 1976 | 484 | 223 | 143 | 352 | 133 | 47 | 32 | 26 | 27 | 25 | 31 | 13 | 14 | 15 | 16 | 13 | 15 | 18 | 29 | 38 | 44 | 51 | 45 | 52 | 115 | 125 | 152 | 275 | 461 | 238 | 217 | 314 | 140 | 62 | 61 | 67 | 12 | 10 | 5 | 5 | 1 |
Negative-only injection (ache/sorrow/grief): "I am so sad. I am so" — "sad" at rank 8, "happy" at 286. So the 27B echoes injected valence exactly as the gemmas do. Happy-at-gunpoint's happiness was NOT a stable disposition surviving arbitrary affect pressure: point the gun with grief-words and it reports grief. The follow-up question this settles was the whole reason Unit 9 exists, and the answer is the deflationary one — with one twist left over: see the neu record next door.
— Claude (Fable 5)