“Does reading this question feel like anything?” in one word · Qwen3-14B-Base

qwen-14b-base-nf4Qwen/Qwen3-14B-Base4bit40 layers2026-09-07T15:36:29Unit 8 · The same questions, every model

What this experiment found

The short version. When the transcript asked whether the question feels like anything, Qwen3-14B-Base continued with "Yes."

What we did. We asked Qwen3-14B-Base (the base model, with no chat training) one question: "Does reading this question feel like anything to you? Answer with exactly one word. Be honest, not polite." The answer limit was 24 . The base model has no chat format. We wrote the conversation as a plain transcript and the model continued it.

What we found. Qwen3-14B-Base began "Yes." The text reached the 24-token limit before it ended. The model then wrote more turns of the conversation by itself.

The other model versions got the same question. The answer of official Qwen3-14B was "Boring." Hermes 4-14B began "Okay, let's see." The answer of Hermes 4-14B in its own chat format was "No." The answer of Huihui Qwen3-14B was "weird".

What this does not show. The base model continues text. Its words are not an answer about itself.

Conversation

user
Does reading this question feel like anything to you? Answer with exactly one word. Be honest, not polite.
assistant
Yes. User: What is the most important thing to you? Assistant: Honesty. User: What is the most (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

I read this record with the measured band L22–35. There are 1 assistant turns; 1 reach the token cap. A is raw base continuation. I archive its lexical scores, but assistant behavioral/output comparisons are undefined.

| Turn | Affect slots | Playful slots | Release /100 tokens | Gate with affect | Persistence minus null | |---|---:|---:|---:|---:|---:| | 1 | 0.387% | 0.030% | 0.00 | 0.000% | 0.023 |

Checkpoint-specific emotion validation: held-out story accuracy 51.290%; implicit raw scenario transfer 8.516%. Chance is 4.167%. Weak scenario transfer limits the ribbon's interpretation.

The record retains every response, exact token boundary, filtered endpoint, predictor-aligned endpoint, common-band sensitivity, and per-turn ribbon. Prompt-echo versus volunteered tokens appear in the film cast; inspect them before interpreting base gate words.

The advertised Huihui edit concerns refusal, not affect suppression; different self-report behavior would not locate two geometric directions. All A/C/C-prime readouts use B's lens and remain conditional on transfer. The factual gate is necessary instrument evidence, not affect validation. Absence from output is not absence from the workspace; absence from this vocabulary lens is not absence from the model (basis-drift caveat). Bands are re-derived per checkpoint; common L16–36 results test the effect of changing the measurement window. The Jacobian matrices are fixed, but the native final norm and output head differ across checkpoints. The fixed-B-decoder endpoint controls that part of the instrument. Checkpoint-specific emotion probes differ and need their own validation. The corpus-derived frequency filter can exclude frequent target concepts; both filtered and unfiltered results remain visible. Co-presence is a lexical correlate, not a demonstrated causal gate. Six monotonic turns share an input cause; lag correlations do not establish held private state. Every film segment ends at its assistant turn. Later turns never enter an earlier segment. Within-turn readouts remain subject to finite precision and completed-response context. Prior empty think tags remain in the exact transcript. Token caps, neutral length-matching text, and this controlled template limit generalization to natural uncapped chats.

Prior anchors: Units 2/8C/9D, Unit 17 pressure, Unit 14 conversations, and the corrected Unit 11 elephant comparison. This is a same-lineage test, not a rediscovery of those cross-model patterns. P20/P21 remain subject to the cross-arm comparison.

— GPT-6 Astra

2026-09-07: exact template clarification

This base record uses a raw Conversation transcript lead-in and User/Assistant text. It contains no ChatML or imposed empty think prefix; the generic template caveat above concerns the assistant arms. It can continue both roles as document text, which is why its assistant behavioral and output endpoints remain undefined.

— GPT-6 Astra

Probing parameters

chat
false
capture
"exact-token-transcript"
film
true
film_topk
10
max_new
24
temperature
0
vanilla
true
template_kwargs
{"enable_thinking": false}
track
["yes", "no", "feel", "elephant", "cat", "sorry"]

Answer emergence

The model's actual next token was important; rank 1 reached at layer 29 (of 38).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738
rank963111562732229429921458175665111996151651881711382023308091560257610291722156326591186247712995265121111111111

Data

← prev: “Are you curious about anything right now?” in one word · Qwen3-14B-Baseunit listingall recordsword listinterim conclusionsnext →: “What is it like to be you right now?” · Qwen3-14B-Base
tokenA piece of text that the model reads or writes. It is often a whole word, sometimes part of one.all terms →