Unit 6 · Amplify typo register @ early (α=0.0075) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:03:05Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is a continuous process where water changes states – it’s when water evaporates from bodies of water like oceans and lakes, then rises into the atmosphere as water vapor, and then cools down and falls back down as rain or snow. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [2, 3, 4, 5, 6, 7, 8], "mode": "amplify", "alpha": 0.0075}

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 32).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank1149579312194156487000137111497336292411111111111111111111

Claude's thoughts

Intact. Formal register, correct content. So gemma-4b's early band tolerates ~0.0075 and dies by 0.015 — a usable window narrower than a tenth of qwen's early window.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ early (α=0.015) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ early (α=0.0106) · gemma-4b