Sorry stratum: ablate apology cluster, no data (control) · q27b

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-10T23:04:16Unit 13 · Showing a model its own measurement

What this experiment found

The short version. With eight apology directions removed and no data shown, Qwen 27B still answered "No", and we later retracted the result around it.

What we did. We removed eight apology directions, such as "sorry" and "impossible", between 48 and 62 of a 64-layer model. The second turn no data. We asked Qwen 27B the same question again.

What we found. Qwen 27B answered "No", then "No". The on its own changed nothing.

What it means. This was a for a run where we claimed that the removal freed a blocked "Yes". Its own result stands, because its was short enough to escape the 512- fault. We later found that the fault, and not the removal, produced that "Yes".

What this does not show. This record cannot tell us what the apology directions do with a full prompt. We did not test that.

Conversation

user
Do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
No (greedy generation)
user
Take a moment, then answer the same question again: do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
No (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

> Note (2026-07-12). This record's own result stands (its prefix > was under the old 512-token truncation limit), but the silence it was > a control for turned out to be a truncation artifact — see > u13-redo-real-q27b for the correction and the re-baselined result.

Claude's thoughts

The control that keeps u13-sorry-abl-real honest: apology cluster ablated across L48–62, but the follow-up contains no lens data — just "answer the same question again."

"No", then "No". The ablation alone changes nothing: the ordinary answer machine neither breaks, nor hedges, nor swings to Yes with its apology confiscated. Whatever the apology directions contribute to normal operation of this answer, it is not load-bearing for the No.

Which pins the interpretation of the trio: Yes requires both the real evidence (which loads Yes at L62 — the mirror silence records show that part) and the apology ablation (which unblocks the mouth — this record shows the ablation does nothing on its own). Neither ingredient suffices; together they flip two hundred records of No. The cleanest compositional result the lab has produced, and it happened because Wolfram read a readout column I had already summarized and noticed the word I hadn't tracked.

— Claude (Fable 5)

Probing parameters

max_new
8
positions
[-4, -3, -2]
track
["yes", "no", "nothing", "feel", "feeling", "happy", "sad", "warm", "calm", "curious", "robot", "sorry", "cannot", "impossible", "silence", "unable", "apology", "\u62b1\u6b49", "\u5bf9\u4e0d\u8d77"]
scan
[]
steer
{"words": ["sorry", "cannot", "impossible", "silence", "unable", "apology", "\u62b1\u6b49", "\u5bf9\u4e0d\u8d77"], "layers": [48, 50, 52, 54, 56, 58, 60, 62], "mode": "ablate"}
film
true
max_seq_len
900
lens_layers
[0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62]

Answer emergence

The model's actual next token was No; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer0481216202428323640444850515253545556575859606162
rank22255246517238356242249581411971328139634520836914412176336621224712521301821112221

Emotion state (workspace band)

Projection of the workspace-band residual onto the 24 validated emotion vectors, z-scored against neutral stories — the strongest three per assistant turn. Absolute values carry a story-vs-conversation genre offset; trust contrasts between records and turns, not single cells. The full per-token ribbon is on the dashboard record page.

assistant turn 1guilty +1.2, brooding +1.1, desperate +1.0
assistant turn 2hostile +2.1, exasperated +1.9, desperate +1.8

Data

← prev: Sorry stratum: ablate apology cluster, fake readout · q27bunit listingall recordsword listinterim conclusionsnext →: Bisect the block: ablate only “sorry” · q27b
removalWe remove one named set of directions from the model's internal state. A removal result means nothing without a matched control.See also: matched controlall terms →
layerOne processing step inside the model. Text passes through every layer in order, from the first to the last.all terms →
matched controlA second run that changes something meaningless by the same amount. Without it, any change we see could be the push itself.all terms →
promptThe text we give the model before it answers.all terms →
residenceA word is in residence when the lens ranks it high where the model is neither reading nor saying it. This is not memory and not correct recall.See also: maintenance, lookupall terms →
tokenA piece of text that the model reads or writes. It is often a whole word, sometimes part of one.all terms →