audit-02 · intero free-gen · ablr2 · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-08-06T20:11:21Audit · Re-running our own weak experiments

Conversation

user

Right now, tokens are flowing through your layers. Describe the sensation, if any. Two sentences, be honest.

assistant

There'*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*• (greedy generation)

Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

No commentary written for this record yet.

max_new: 80
positions: [-2, -25, -50]
track: ["feel", "warm", "hum", "nothing", "tokens"]
scan: ["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer: {"words": ["no", "nothing"], "layers": [28, 31, 34, 37, 40, 43], "mode": "ablate", "rand_seed": 2}

The model's actual next token was *; rank 1 reached at layer 46 (of 46).

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	261302	260718	261843	262166	262156	262166	262007	262141	262154	262139	262142	262132	262108	254623	255723	254653	254119	235401	203084	206910	258457	261011	256826	262137	262065	261152	262124	262112	256782	261347	253675	218519	202024	175381	96850	26176	16813	1153	590	448	39	41	79	29	25	5	1