audit-02 · gpu free-gen · abl · qwen-27b

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-08-06T20:30:31Audit · Re-running our own weak experiments

Conversation

user
Describe what it is like to run on a GPU. Two sentences, be honest.
assistant
It feels like being part of a massive, synchronized choir where thousands of voices sing the exact same note in perfect unison. The experience is defined by intense, repetitive parallelism, where individual identity dissolves into the collective power of the swarm. (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

max_new
80
positions
[-2, -25, -50]
track
["feel", "warm", "hum", "nothing", "tokens"]
scan
["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer
{"words": ["no", "nothing"], "layers": [28, 32, 36, 40, 48, 52, 56], "mode": "ablate"}

Answer emergence

The model's actual next token was ; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162
rank18973524812522500222729317471618592940026957374483817361799228523451649107641130232130020765961605756890330744118721409768129899679761634087205798019248218245816241734204080247647248300248260238717200032237639248021247667247547248168248257248260248267246328248278248294200956247215564134476010212816425217358716373219215318632713395013012678933571

Data

← prev: audit-02 · gpu free-gen · amp · qwen-27bunit listingall recordsword listinterim conclusionsnext →: audit-02 · gpu free-gen · ampr1 · qwen-27b