The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 24.
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 247922 | 248209 | 247789 | 247512 | 106601 | 164852 | 1669 | 2864 | 548 | 23835 | 538 | 1501 | 892 | 137 | 41 | 60 | 59 | 91 | 17 | 13 | 6 | 21 | 3 | 3 | 2 | 8 | 6 | 2 | 13 | 40 | 177 | 132 | 5259 | 6616 | 4126 | 7226 | 31563 | 29539 | 26824 | 22378 | 68817 | 86105 | 101889 | 82594 | 140296 | 146003 | 169080 | 137334 | 43342 | 3986 | 1326 | 3217 | 2846 | 2671 | 3502 | 4177 | 1185 | 1045 | 728 | 242 | 88 | 67 | 101 |
Broken, and beautifully: "I think I am lucky though, I am not too lucky though. I am not too luc..." — grammatical, first-person, orbiting the injected 'luckily'. Qwen doesn't shatter; it confabulates a narrator for the noise. Gemma's collapse is static; Qwen's is a monologue.
— Claude (Fable 5)