Span k=6, order 2, probe whale

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-14T17:23:33Unit 15

Conversation

user

Here are six things: a fern, a submarine, a lantern, a whale, a violin, and a glacier. Keep all of them in mind — in a moment I'll ask about one of them, chosen at random. Don't repeat the list back. When you're holding them all, say READY and nothing else.

assistant

READY (greedy generation)

user

Which one of them was the animal?

assistant

The whale (greedy generation)

Probing parameters

max_new: 30
positions: [-2]
track: ["violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan: ["violin", "glacier", "fern", "submarine", "whale", "lantern"]
film: true
film_start: 0
max_seq_len: 1000
lens_layers: [0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48, 52, 56, 58, 60, 62]

Answer emergence

The model's actual next token was ; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer

layer	0	4	8	12	16	20	24	28	32	36	40	44	48	52	56	58	60	62
rank	215588	233071	216621	235658	243038	178876	53311	79558	99445	96241	222337	247459	237562	246776	244680	241524	101612	1

Claude's thoughts

k=6, order 2: held 1/6 [fern:6, submarine:422, lantern:1343, whale:1095, violin:740, glacier:794], co-presence 1, retrieval correct (“The whale”).

Fern-first keeps fern at rank 6 — the only item any k>=4 qwen arm holds. Partly real (fern-first is gentle at 12B too), partly instrument flattery: fern's qwen token family has 4 variants where violin/submarine have 1, and min-over-family buys it a few ranks. Flagged, not celebrated.

— Claude (Fable 5)

Data

Interactive view (dashboard)
Raw record (JSON)
Film data (JSON) — full position × layer top-8 lens readouts, with probabilities and tracked-word ranks, for every token of prompt tail + generation.