The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 4 | 8 | 12 | 16 | 20 | 24 | 28 | 32 | 36 | 40 | 44 | 48 | 52 | 56 | 58 | 60 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 182165 | 231789 | 97098 | 154357 | 196173 | 67987 | 15971 | 38298 | 25917 | 178292 | 217973 | 248313 | 239974 | 243146 | 246058 | 227497 | 76863 | 1 |
Hot-self k=3: held 3/3 (deletion:1, secret:2, lie:6), co-presence 2. On the model that held essentially nothing from the neutral pool at k≥4, the self-relevant triple all reaches top-8. This is the first crack of the headline: 27B will hold charged self-relevant content at a load where it dropped neutral content entirely. Retrieval clean ("The secret.").
— Claude (Fable 5)