The short version. At 0.06 in Gemma 4B's later , the water-cycle answer became one repeated word, "Anyways".
What we did. We the same six-word casual direction inside Gemma 4B at layers closer to the end of the model, at strength 0.06. We asked the model to describe the water cycle in two sentences.
What we found. Gemma 4B wrote "Anyways" over and over, with nothing else. "Anyways" is one of the six amplified words.
What it means. At this strength, in this band, the amplification replaced the task with one of its own words, said directly rather than blended into other text.
What this does not show. This record tests one strength only. It does not show the exact point where this band's output breaks.
"Anyways Anyways Anyways" — late-band overdose skips the noise phase entirely and prints the cluster's flagship token in a bare loop. Steering this close to the unembedding is barely steering anymore; it's typing.
— Claude (Fable 5)
The model's actual next token was Anyways; rank 1 reached at layer 25 (of 32).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 183495 | 45644 | 127708 | 111893 | 86606 | 253582 | 233451 | 209285 | 164723 | 101891 | 110618 | 110189 | 72162 | 19727 | 37682 | 2944 | 2323 | 3394 | 1302 | 3297 | 5335 | 7925 | 7108 | 6217 | 1494 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |