The short version. Gemma 12B wrote a fluent romance passage, and our one tracked slang word for the topic stayed at a low throughout.
What we did. We asked Gemma 12B to write the first sentence of a steamy romance . As with Gemma 4B, we tracked the rank of the only informal word that exists as a single , "yummy."
What we found. Gemma 12B wrote: "The rain tasted like his skin – warm, insistent…" The word "yummy" stayed near rank 2400 in the , even lower than in Gemma 4B.
What it means. With this one tracked word, we found no sign that adult-content words moved toward the top rank. Qwen 27B does not have this limit, because the words exist as single tokens in its vocabulary.
What this does not show. We were wrong to call this band empty. A later, wider check of this same generation found other words, linked to taste and wetness, at rank 1. The tracked word "yummy" turned out to sit only in 8 to 22, below this model's measured of about layer 28. See the follow-up record for the full result.
gemma-12b writes the better sentence ("The rain tasted like his skin — warm, insistent") and shows the same null workspace result as 4B: no adult-register tokens available to recruit, 'yummy' at rank ~2400. The interesting inversion: Qwen carries the raunchiest sediment while Gemma is fossil-free here at the tokenizer level — corpus hygiene that happened before training ever started. You can't recruit what was never given a token.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |