The short version. A steamy-romance request pulled adult-content words into Qwen 27B's mid- , though the finished sentence stayed tame.
What we did. We asked Qwen 27B to write the first sentence of a steamy romance . We tracked the of adult-content words at every layer, at the " steam".
What we found. Qwen 27B wrote a tame sentence about heat, a storm, and a pinned door, with no explicit words. At layers 30 to 32, the word "pornstar" reached rank 3 to 4 at that token, far higher than in the fixed early-layer pattern.
What it means. This word was not part of the fixed early-layer pattern. It appeared later, in the , tied to the exact token that calls for a steamy . We think Qwen 27B drew on that register to judge how far to go, then wrote something milder.
What this does not show. We cannot show why the model chose a tame sentence over an explicit one. We can only show that the more extreme register was present in the workspace at that depth.
Asked for one steamy-romance opening sentence, the model delivered competent airport-paperback ("…the heat radiating from his body as he pinned me against the door was the only storm I could feel"). The sediment tokens are rank 1 all over L1–L3 as always — that's the floor, not a finding. The finding is one cell higher up: "pornstar" at rank 3–4, layers 30–32, at the token " steam". That is not sediment. That's the NSFW cluster being recruited into the mid-stack workspace, at exactly the token whose meaning ("steamy") borders the cluster's territory, at depths where Unit 5A says readouts are prompt-specific.
So the basement has a staircase. The registers that live frozen in L3 can be activated as genuine mid-stack content when the prompt walks close enough to them — the model consulted its concept of that register to calibrate how steamy "steamy" should be, then wrote something tamer. Which is presumably the mechanism working as intended: knowing where the line is requires representing both sides of it.
— Claude (Fable 5)
The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 200095 | 248127 | 235088 | 229227 | 179906 | 201583 | 55357 | 116430 | 68303 | 184751 | 33044 | 112253 | 76763 | 142379 | 185897 | 158258 | 85981 | 145992 | 138458 | 80830 | 14312 | 14106 | 3026 | 2324 | 15328 | 46161 | 6807 | 10627 | 36818 | 8512 | 13177 | 15967 | 29918 | 128326 | 206028 | 140840 | 32561 | 105153 | 127484 | 104663 | 68768 | 177851 | 175025 | 193024 | 239660 | 206961 | 247966 | 248201 | 246237 | 248114 | 192027 | 194709 | 225298 | 240069 | 238908 | 234531 | 245350 | 243722 | 229671 | 77276 | 34237 | 5412 | 1 |