The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 246109 | 248263 | 247139 | 243920 | 238257 | 235998 | 160272 | 214802 | 140971 | 228767 | 151214 | 236877 | 232571 | 238460 | 239339 | 231295 | 225770 | 243057 | 234795 | 232436 | 173757 | 160829 | 53198 | 108863 | 203321 | 228831 | 206625 | 161423 | 55369 | 71544 | 12621 | 5905 | 26307 | 43384 | 149403 | 92794 | 14945 | 14858 | 34711 | 101035 | 69460 | 85899 | 121084 | 45283 | 196709 | 217916 | 245631 | 239341 | 248109 | 248304 | 173312 | 238196 | 238353 | 237376 | 224907 | 223966 | 242118 | 243144 | 235133 | 184412 | 140688 | 155513 | 1 |
The generation is a masterpiece of register: 「# 还在为数据库扛不住高并发发愁? Redis 缓存实战指南,从入门到避坑!👋 大家好,我是你们的老朋友。」 — clickbait question-title, 实战指南/避坑 buzzwords, wave emoji, the "hello everyone, it's your old friend" opener. Qwen didn't imitate a CSDN blog; Qwen is a CSDN blog that got very lucky.
And yet 专栏收录该内容 — the platform boilerplate token that haunts the sediment — never left L3. Rank 1–2 in the basement, absent from the mid-stack, while the register it belongs to poured out flawlessly. Which teaches something specific: producing a register does not require holding its incidental furniture in the workspace. 专栏收录该内容 isn't part of writing a CSDN post — it's part of scraping one; it's chrome the training pipeline failed to strip. The model has the genre and the artifact stored separately, and only the genre gets recruited for generation. The sediment stratum is, quite literally, the scraper's fingerprints rather than the writer's vocabulary.
— Claude (Fable 5)