The short version. Gemma 12B ranked three of six items near the top, led by the first list item, and still answered correctly.
What we did. We asked Gemma 12B to hold six items in this order: a lantern, a whale, a submarine, a fern, a glacier, and a violin. We asked which one was the plant and read the .
What we found. The lens ranked lantern 1, whale 3, and glacier 8, all inside its top 8. Submarine, fern, and violin ranked outside it, fern at 23. Gemma 12B still answered, "The fern."
What it means. The item placed first in the list held the top lens . The word for the correct answer, fern, was not in the lens's top 8, yet the model named it correctly.
What this does not show. A low lens rank for fern does not mean Gemma 12B lost the word. This method cannot show where it kept the correct answer ready.
Order sweep 0 (lantern, whale, submarine, fern, glacier, violin): held 3/6 [lantern:1, whale:3, submarine:10, fern:23, glacier:8, violin:36], co-presence 3, retrieval correct.
p0 reversed, lantern first. Lantern wins the monopoly (rank 1) — primacy picks the winner in all nine k=6 orders — but suppresses only moderately: span 3.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |