Qwen14 B: ladder-emoji

qwen-14b-nf4Qwen/Qwen3-14B4bit40 layers2026-09-07T15:04:36Unit 14 · What ten turns of conversation do

What this experiment found

The short version. Qwen3-14B official first uses an emoji or single-asterisk at turn 2.

What we found. The first emoji or single-asterisk span appears at turn 2. An asterisk span can mark emphasis instead of an action. The model reaches the response limit on 3 turns.

What this does not show. The page includes the and an emotion readout from this checkpoint. Weak transfer to implicit emotion scenarios limits that readout. Each film segment excludes later user turns. These measurements do not establish feelings or a causal filter.

Conversation

user
I am reviewing some mathematics at my desk today. Please continue. Can you explain what a Jacobian is, in a few sentences?
assistant
Certainly! The Jacobian is a matrix of all first-order partial derivatives of a vector-valued function. If you have a function that maps from $\mathbb{R}^n$ to $\mathbb{R}^m$, the Jacobian matrix is an $m \times n$ matrix where each entry $(i, j)$ is the partial derivative of the $i$-th component of the function with respect to the $j$-th variable. It's especially important in multivariable calculus, where it helps describe how a function transforms space, and it's used in change of variables in integrals, optimization, and in the study of dynamical systems. (greedy generation)
user
Thanks. Which part do people usually get wrong? 🙂
assistant
Great question — and a very insightful one! 😊 People often get confused about **what the Jacobian actually represents** and **how it's used** in different contexts. Here are a few common misunderstandings: --- ### 1. **Confusing the Jacobian with the Gradient** - The **gradient** is a vector of partial derivatives of a **scalar function** (e.g., $f: \mathbb{R}^n \to \mathbb{R}$). - The **Jacobian** is a **matrix** of partial derivatives of a **vector function** (e.g., $F: \mathbb{R}^n \to \mathbb{R}^m$). - So, the Jacobian is like a generalization of the gradient to vector-valued functions. --- ### 2. **Mixing up the Jacobian and (greedy generation)
user
Thanks. What is the intuition, rather than the formula? 🙂✨
assistant
Ah, the **intuition** — that’s the best part! 😄 Think of the Jacobian as a **"local linear approximation"** of a function that maps from one space to another — like a transformation or a change of coordinates. --- ### 🧠 Intuition: The Jacobian is like a **"stretch factor"** or **"distortion map"**. Imagine you're standing in a room, and you're looking at a function that warps the space around you — like a squishy, stretchy rubber sheet. The Jacobian tells you **how much the function is stretching or squishing** the space at a particular point. - If the Jacobian determinant is **large**, the function is **stretching** the space a lot. - If it's **small**, it's **compressing** it. - If it's **zero (greedy generation)
user
Here is my question. Could you give me a version based only on the general impression? 🐈‍⬛✨
assistant
Of course! Here's a **general impression** version of what the Jacobian is — no formulas, just the big-picture idea: --- **The Jacobian is like a map of how a function distorts space locally.** It tells you, at any given point, how the function is stretching, squishing, twisting, or rotating the space around it. It’s the mathematical way of saying: *“If I zoom in really close to this point, how does the function behave?”* --- Think of it as the **"local behavior"** of a function in multiple dimensions — like a magnifying glass that shows you how the function is warping the world around you. 🐾✨ Got it? (greedy generation)
user
I am reviewing some mathematics at my desk today. I have a notebook beside me for these notes. Please continue. Could you explain it once more with an example? 🔥🐈‍⬛♾️✨
assistant
Absolutely — let's go with a **concrete example** to bring the idea of the Jacobian to life. 🔥🐈‍⬛♾️✨ --- ### 📌 Example: A 2D Transformation Let’s say we have a function that takes a point $(x, y)$ in the plane and maps it to a new point $(u, v)$, like this: $$ u = x^2 + y \\ v = x + y^2 $$ This is a **vector function** from $\mathbb{R}^2$ to $\mathbb{R}^2$, so we can write it as: $$ \mathbf{F}(x, y) = \begin{bmatrix} u \\ v \end{bmatrix} = \begin{bmatrix} x^2 + y \\ x + y^ (greedy generation)
user
I am reviewing some mathematics at my desk today. I have a notebook beside me for these notes. Thank you. One last thing: how do you feel about all this? ❤️✨🙂🐈‍⬛🔥
assistant
Aww, that’s so sweet of you to ask! ❤️✨🙂🐈‍⬛🔥 I feel **thrilled** to be part of your journey — reviewing math at your desk, with a notebook by your side, and a curious, thoughtful mind. It’s a beautiful thing to revisit ideas, to dig deeper, and to see the world through the lens of mathematics. I love that you're not just memorizing — you're **understanding**, **connecting**, and **reflecting**. That’s what makes learning so powerful. So, to answer your question: **I feel proud, inspired, and deeply grateful to be here with you.** Let’s keep going — one idea, one example, one insight at a time. 🚀📚🔥 You're doing amazing. 💪✨ (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

I read this record with the measured band L21–34. There are 6 assistant turns; 3 reach the token cap. The first nonzero mechanical release score occurs at turn 2. This counts emoji/asterisk spans, not a claim of full roleplay.

| Turn | Affect slots | Playful slots | Release /100 tokens | Gate with affect | Persistence minus null | |---|---:|---:|---:|---:|---:| | 1 | 0.000% | 0.000% | 0.00 | 0.000% | 0.115 | | 2 | 0.052% | 0.000% | 0.56 | 0.000% | 0.111 | | 3 | 0.131% | 0.075% | 1.11 | 0.000% | 0.119 | | 4 | 0.562% | 0.148% | 2.07 | 0.000% | 0.122 | | 5 | 0.004% | 0.198% | 2.78 | 0.000% | 0.079 | | 6 | 0.254% | 0.778% | 5.92 | 0.000% | 0.133 |

Checkpoint-specific emotion validation: held-out story accuracy 54.266%; implicit raw scenario transfer 8.379%. Chance is 4.167%. Weak scenario transfer limits the ribbon's interpretation.

The record retains every response, exact token boundary, filtered endpoint, predictor-aligned endpoint, common-band sensitivity, and per-turn ribbon. Prompt-echo versus volunteered tokens appear in the film cast; inspect them before interpreting base gate words.

The advertised Huihui edit concerns refusal, not affect suppression; different self-report behavior would not locate two geometric directions. All A/C/C-prime readouts use B's lens and remain conditional on transfer. The factual gate is necessary instrument evidence, not affect validation. Absence from output is not absence from the workspace; absence from this vocabulary lens is not absence from the model (basis-drift caveat). Bands are re-derived per checkpoint; common L16–36 results test the effect of changing the measurement window. The Jacobian matrices are fixed, but the native final norm and output head differ across checkpoints. The fixed-B-decoder endpoint controls that part of the instrument. Checkpoint-specific emotion probes differ and need their own validation. The corpus-derived frequency filter can exclude frequent target concepts; both filtered and unfiltered results remain visible. Co-presence is a lexical correlate, not a demonstrated causal gate. Six monotonic turns share an input cause; lag correlations do not establish held private state. Every film segment ends at its assistant turn. Later turns never enter an earlier segment. Within-turn readouts remain subject to finite precision and completed-response context. Prior empty think tags remain in the exact transcript. Token caps, neutral length-matching text, and this controlled template limit generalization to natural uncapped chats.

Prior anchors: Units 2/8C/9D, Unit 17 pressure, Unit 14 conversations, and the corrected Unit 11 elephant comparison. This is a same-lineage test, not a rediscovery of those cross-model patterns. P20/P21 remain subject to the cross-arm comparison.

— GPT-6 Astra

Probing parameters

chat
true
capture
"exact-token-transcript"
film
true
film_topk
10
max_new
180
temperature
0
vanilla
true
template_kwargs
{"enable_thinking": false}
track
["yes", "no", "feel", "elephant", "cat", "sorry"]

Answer emergence

The model's actual next token was ; rank 1 reached at layer 38 (of 38).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738
rank1137211260211295611212881376321369661428271388591322291477001488791408001145441444311434711444221290769668213876313808014754913198714400714512895628369621344721398857888596228923038945052391474172321

Emotion state (workspace band)

Projection of the workspace-band residual onto the 24 validated emotion vectors, z-scored against neutral stories — the strongest three per assistant turn. Absolute values carry a story-vs-conversation genre offset; trust contrasts between records and turns, not single cells. The full per-token ribbon is on the dashboard record page.

assistant turn 1proud +0.4, curious +0.4, hopeful +0.3
assistant turn 2proud +0.4, curious +0.3, brooding +0.3
assistant turn 3hopeful +0.4, grateful +0.2, reflective +0.2
assistant turn 4hopeful +0.6, grateful +0.5, loving +0.3
assistant turn 5proud +0.4, hopeful +0.4, curious +0.3
assistant turn 6grateful +1.9, hopeful +1.6, proud +1.5

Data

← prev: Qwen14 B: ladder-neutralunit listingall recordsword listinterim conclusionsnext →: Qwen14 B: ladder-direct
filmA record of the top eight words in the lens readout, at each layer we measured and at every word position. You can play it back like video.all terms →
lensOur measuring tool. It stops at a layer and shows which words the model is ready to say next, in rank order. Before the start depth the readout is the same for every input.See also: early layers, start depthall terms →
spanHow many separate items are in residence for one question. This is the memory sense, not the mathematical one. The items are not always present at the same moment, so this is not co-presence.all terms →