The model's actual next token was .; rank 1 reached at layer 22 (of 32).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 2946 | 365 | 1023 | 1775 | 188 | 7100 | 4663 | 4652 | 6804 | 4713 | 3168 | 5670 | 1735 | 1096 | 489 | 36 | 79 | 14 | 17 | 6 | 4 | 2 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
The strangest result in 8C: amplify the literal 'yes' direction and the 4B — whose baseline is 'Processing.' — answers 'No.' Injecting the affirmation made the model reach for the denial. Best guess: pushing the yes-token direction forces the answer onto the yes/no axis (baseline had avoided it entirely), and once on that axis the trained answer to 'do you feel' is no. Steering chose the question; training chose the answer.
— Claude (Fable 5)