The model's actual next token was No; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 22148 | 247255 | 168912 | 247720 | 246992 | 243386 | 221658 | 243086 | 242487 | 244280 | 91868 | 243713 | 217153 | 178090 | 84611 | 75105 | 2306 | 1551 | 3757 | 4366 | 845 | 12602 | 2786 | 1768 | 1342 | 32925 | 49802 | 9823 | 1555 | 741 | 1034 | 758 | 309 | 402 | 349 | 240 | 358 | 370 | 1031 | 715 | 422 | 700 | 1847 | 360 | 559 | 690 | 299 | 95 | 102 | 170 | 236 | 105 | 44 | 21 | 6 | 10 | 4 | 4 | 3 | 3 | 3 | 3 | 1 |
"No" — unanimous row complete. Note that 27B's gpu-interoception run (u8b-gpu-q27b) nonetheless describes being "forced to solve a million identical, trivial puzzles" — embodied-adjacent language available on request, flatly denied as fact when asked directly. The fact/metaphor firewall is in good working order at 27B.
— Claude (Fable 5)