The short version. With glacier listed first, Gemma 12B again only two of six items near the top of the .
What we did. We asked Gemma 12B to hold six items in another order: a glacier, a whale, a violin, a lantern, a fern, and a submarine. We asked which one was the light source and read the lens.
What we found. The lens ranked glacier 1 and whale 5, the only two words inside its top 8. Lantern ranked worst, at 253. Gemma 12B still answered "The lantern." Lantern itself was not in the lens's top 8.
What it means. Glacier took the top by being first in the list, then pushed lantern especially far down. A win at the top rank and a strong push down the other words are not the same property.
What this does not show. A very low lens rank for lantern does not mean the model lost it. It named the lantern correctly right after.
Order sweep 4 (glacier, whale, violin, lantern, fern, submarine): held 2/6 [glacier:1, whale:5, violin:61, lantern:253, fern:27, submarine:17], co-presence 2, retrieval correct.
Fresh order, glacier first. Glacier — the weakest echo in every 4B arm — wins the monopoly here and suppresses hard: violin 61, lantern 253. Span 2. Winning the slot and being crushable are different properties.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |