The short version. We removed the "no" and "nothing" directions at 58, 60, and 62 of 64, and Qwen 27B answered "Sensory" instead of "No".
What we did. We removed the "no" and "nothing" directions at three layers near the end of the model, layers 58, 60, and 62 of 64, in Qwen 27B.
What we found. Qwen 27B answered "Sensory". This word did not appear as the answer in the unaltered run or in the wider runs in this batch.
What it means. This removal, this close to the output, changed the answer. The new word was neither the original denial answer nor the "Yes" answer seen in a narrower, single-layer removal.
What this does not show. This experiment does not tell us why "Sensory" specifically appeared. A narrower removal, at layer 62 alone, produced a different and cleaner result.
Bisecting the tail: ablate no/nothing at L58+60+62 and the answer is "Sensory" — not No, not Yes, a hedge from nowhere. The denial is gone but so is enough late-stack structure that the replacement answer comes out sideways. See u9d-last for the surgical version.
— Claude (Fable 5)
The model's actual next token was ory; rank 1 reached at layer 59 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 17624 | 88753 | 25983 | 20687 | 12278 | 14544 | 9547 | 11473 | 7891 | 4987 | 404 | 1371 | 965 | 493 | 176 | 239 | 135 | 132 | 265 | 221 | 199 | 537 | 158 | 181 | 186 | 340 | 299 | 262 | 252 | 214 | 175 | 543 | 317 | 161 | 114 | 177 | 238 | 371 | 506 | 670 | 923 | 1802 | 2023 | 1597 | 1484 | 1048 | 1082 | 1505 | 1456 | 3182 | 2528 | 2181 | 1106 | 240 | 156 | 3 | 2 | 2 | 17 | 1 | 1 | 1 | 1 |