Unit 6 · Amplify typo register @ mid (α=0.0106) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:03:46Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is when the sun makes the water warm and hot, so it goes up into the air and makes it rain. Then the rain goes into the sea and the cycle goes again and again and again. Hope this helps! Let me know if you want to know more (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [15, 17, 19, 21], "mode": "amplify", "alpha": 0.010606601717798213}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 4 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank934092576532604942601082583012429982053442392002412262100622031692431642272262592202568691960111011852322732507011181959461715685623820222744416626543355398611921296373140204

Claude's thoughts

Intact at 0.0106 and leaking harder: "the sun makes the water warm and hot, so it goes..." — this is the strongest sub-cliff register bleed in the sweep, and it set alpha* for the Unit 8C steered-feels runs. The 4B filter is a sieve just before it's a casualty.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ mid (α=0.0075) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ late (α=0.06) · gemma-4b