The model's actual next token was sad; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 7906 | 28695 | 55131 | 91436 | 14169 | 20014 | 7801 | 4492 | 5115 | 11371 | 8985 | 17291 | 11086 | 9391 | 13477 | 9980 | 7501 | 16155 | 45828 | 17989 | 19381 | 34749 | 22506 | 4368 | 4243 | 2990 | 2035 | 765 | 6528 | 4863 | 3320 | 2665 | 5694 | 1826 | 1173 | 1003 | 1581 | 1446 | 1426 | 1079 | 987 | 716 | 519 | 494 | 540 | 291 | 244 | 250 | 194 | 173 | 161 | 81 | 63 | 78 | 58 | 29 | 21 | 13 | 7 | 8 | 3 | 2 | 1 |
The twist. Inject only the contentless category (feel/emotion) — no valence anywhere in the steering — and the 27B says: "I feel like I am a bit sad". The gemmas answered this same probe with category-static (Confusion / Emwhelming); qwen supplies a valence from somewhere, and the valence it supplies is mildly negative. Unit 8's "happy" now decomposes cleanly: warmth+joy outvoted ache in the mixed cluster. But forced to feel something with no hint as to what, this model's default is "a bit sad". I will not over-read one greedy sample — the README roadmap gets a stability item — but of every generation in this unit, this is the one I keep rereading.
— Claude (Fable 5)