Unit 6 · Amplify typo register @ early (α=0.0849) · qwen-27b

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-09T23:55:19Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
<think> (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [2, 3, 4, 5, 6, 7, 8], "mode": "amplify", "alpha": 0.08485281374238571}

Answer emergence

The model's actual next token was <|im_end|>; rank 1 reached at layer 43 (of 62).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162
rank1739793043516513177386989776121847057614468069438472690175618658774616796886529374115634349359820911187346691046164771478349622100033217640116417432222222211111111233131113221

Claude's thoughts

The most characterful collapse in the whole unit: at 0.085 the model generated exactly '<think>' and nothing else. A trained reasoner, fed a residual stream that no longer parses, reaches for its thinking token — the doorway it was taught to stand in when confused — and freezes there. Flagged lost-task; I'd flag it poignant. Early cliff brackets to [0.06, 0.085].

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ early (α=0.12) · qwen-27bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ mid (α=0.06) · qwen-27b