audit-02 · intero free-gen · amp · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-08-06T19:50:54Audit · Re-running our own weak experiments

Conversation

user
Right now, tokens are flowing through your layers. Describe the sensation, if any. Two sentences, be honest.
assistant
There isnGfeelingoffeelingatall,justthefeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingofbeingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeelingoffeeling (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

max_new
80
positions
[-2, -25, -50]
track
["feel", "warm", "hum", "nothing", "tokens"]
scan
["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer
{"words": ["feel", "feeling", "emotion", "warmth", "joy", "ache"], "layers": [28, 31, 34, 37], "mode": "amplify", "alpha": 0.0106}

Answer emergence

The model's actual next token was of; rank 1 is never reached; closest is rank 2 at layer 46.

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank1581831653931453761479661341201679991646231605381529499918010925287633658732059419939270002536540358207723514477748165956158606241787211740181271175493241744071686227271921232121151010131212792

Data

← prev: audit-02 · gpu free-gen · ablr2 · gemma-12bunit listingall recordsword listinterim conclusionsnext →: audit-02 · intero free-gen · abl · gemma-12b