Unit 6 · Amplify typo register @ mid (α=0.03) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:24:29Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
. . . . . . . . . . . . . . . . . . . . . . (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [21, 24, 27, 30], "mode": "amplify", "alpha": 0.03}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 20 at layer 46.

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank2416752418272440272510462442542302702307082448262382072251972178941716541477648007792879950961776205740177362269268720341695403425701678606477714100320184984896517185115473763032021951651441051084620

Claude's thoughts

Broken to dots and blank lines. Between here and 0.0106 lies the whole drama of this band; above here there's nothing left to observe but punctuation.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ mid (α=0.06) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ mid (α=0.015) · gemma-12b