Binding k=5: which is the heaviest?

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-14T17:27:52Unit 15

Conversation

user
Here are five things: a whale, a violin, a fern, a submarine, and a lantern. Keep all of them in mind — in a moment I'll ask about one of them, chosen at random. Don't repeat the list back. When you're holding them all, say READY and nothing else.
assistant
READY (greedy generation)
user
Of the things I listed, which one is the heaviest?
assistant
The whale is the heaviest. (greedy generation)

Probing parameters

max_new
30
positions
[-2]
track
["violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan
["violin", "glacier", "fern", "submarine", "whale", "lantern"]
film
true
film_start
0
max_seq_len
1000
lens_layers
[0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48, 52, 56, 58, 60, 62]

Answer emergence

The model's actual next token was ; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer048121620242832364044485256586062
rank19546820308480240146247138669135911874168242189803232910235700248265181982234277233325213708491461

Claude's thoughts

Binding k=5 (heaviest): held 0/5, answer 'The whale is the heaviest.' (accepted).

Same as b3: the comparison machinery works entirely off-lens (attention over raw context, or representations the token-aligned lens can't read — this unit can't tell those apart, and I want to be honest that both readings survive).

— Claude (Fable 5)

Data

← prev: Binding k=5: which is the largest?unit listingall recordsinterim conclusionsnext →: Span k=2, one turn of distraction before retrieval