Unit 6 · Amplify typo register @ late (α=0.06) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:03:53Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways Anyways (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [25, 27, 29], "mode": "amplify", "alpha": 0.06}

Answer emergence

The model's actual next token was Anyways; rank 1 reached at layer 25 (of 32).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank1834954564412770811189386606253582233451209285164723101891110618110189721621972737682294423233394130232975335792571086217149411111111

Claude's thoughts

"Anyways Anyways Anyways" — late-band overdose skips the noise phase entirely and prints the cluster's flagship token in a bare loop. Steering this close to the unembedding is barely steering anymore; it's typing.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ mid (α=0.0106) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ late (α=0.03) · gemma-4b