Unit 6 · Amplify typo register @ mid (α=0.0106) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:25:27Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water is a cycle, so it is. First, the water is going to be in the water, then it will be in the air. Then it will be back again. Hope this helps! Let me know if you want to know more. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [21, 24, 27, 30], "mode": "amplify", "alpha": 0.010606601717798213}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 45.

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank252067252228250246248178226632189903197378211312203637197380138050901237302762543100745859171813232688411443451767419966762953071158422245243143789215024024730038960939315399844029124823

Claude's thoughts

Intact by the flags, and the best register leak of the 12B sweep: "The water is a cycle, so it is. First, the water is going to be in the..." — that 'so it is' is pure spoken-English filler, the typo cluster's register showing through grammatically perfect output. Set alpha* for 12B's Unit 8C. The filter bends visibly before it snaps.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ mid (α=0.0075) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ late (α=0.06) · gemma-12b