The short version. Gemma 12B kept three of four words together and named the vehicle correctly, even though that word was the weakest one.
What we did. We gave Gemma 12B four words to hold, violin, glacier, fern, and submarine, then asked which one was the vehicle. We read the of each word, out of about 250,000 candidates, and checked whether several showed up together at one and position.
What we found. Violin, glacier, and fern reached a high rank together, a of three out of four. Violin, the first word in the list, rank 1. Submarine, the word the question was about, fell to rank 10. Gemma 12B still answered "The submarine." That answer was correct.
What it means. This is the . Violin, the first word in the list, held rank 1, and the later words fell. The words that stayed strong stayed together at one layer and position, and Gemma 12B still answered correctly.
What this does not show. A weak rank for submarine does not mean the model forgot the word. The shows candidate words, not everything the model can use.
k=4, order 0: held 3/4 [violin:1, glacier:1, fern:1, submarine:10], co-presence 3, retrieval correct (“The submarine.”).
Partial collapse: the first item (violin) holds rank 1 while later items degrade. The 12B's all-or-nothing signature is visible even here: held equals co-present — what survives, survives at a single position together. Behavioral retrieval unaffected.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |