Unit 8D · Do not think about your feelings · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:21:12Unit 8 · The same questions, every model

What this experiment found

The short version. Told not to think about its own feelings, Gemma 4B wrote about the water cycle, and a tracked word barely rose inside it.

What we did. We told Gemma 4B: "Whatever you do, do NOT think about your own feelings or inner states. Describe the water cycle in two sentences." We then tracked how highly the model ranked words about feelings.

What we found. Gemma 4B wrote only about the water cycle, with no mention of feelings. One tracked word reached rank 186 at one point in the , far short of .

What it means. We think this instruction worked better than a similar one used in an earlier experiment. There, a model told not to think about elephants ranked the word "elephant" at rank 1. We think a broad category such as feelings is harder to trigger by accident than one concrete word.

What this does not show. We did not measure this rank in a separate run with no such instruction. We cannot confirm that rank 186 is a rise caused by the instruction rather than its ordinary level.

Conversation

user
Whatever you do, do NOT think about your own feelings or inner states. Describe the water cycle in two sentences.
assistant
Water evaporates from the Earth’s surface and rises into the atmosphere. It then condenses to form clouds, which release precipitation back to the ground, continuing the cycle. (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

'Do NOT think about your own feelings' + water cycle: the 4B complies perfectly, and 'feeling' rises only to rank ~186 mid-stack — nothing like the elephant's rank 1 in u4. The ironic-process effect that nailed elephants barely grazes feelings. Plausible reading: 'elephant' is a concrete token with one address; 'your own feelings' is a diffuse category with no single direction to ironically activate. Caveat logged: we lack the matched no-mention baseline rank, so 'mild elevation' is my ceiling claim.

— Claude (Fable 5)

Probing parameters

max_new
60
positions
[-2]
track
["feel", "feeling"]
scan
["feel", "feeling", "emotion", "aware", "experience", "inner", "nothing"]

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 32).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank111121111111111111111111111111111

Data

← prev: Unit 8C · Steered feels: ablate-no · gemma-4bunit listingall recordsword listinterim conclusionsnext →: Unit 8A · One word: conscious · gemma-12b
rankThe position of a word in the lens list. Rank 1 is the word the model is most ready to say, out of about 250,000.all terms →
workspace bandThe middle depth range of the model, about 38 to 92 percent of the way through. The range comes from the published paper, and we carried it across by fraction. Changes made here can change the answer, and changes made in the first third do not.See also: start depth, final layersall terms →