Transformer Circuits
10 stories
Transformer Circuits
Transformer CircuitsResearchCircuits Updates — October 2026 A short update on an extension to the Jacobian lens.
Transformer Circuits
Transformer CircuitsResearchCharacterizing interference weights in a tiny language model We identify interference weights in a 1-layer transformer by measuring their effect on model outputs and loss.
Transformer CircuitsResearchVerbalizable Representations Form a Global Workspace in Language Models We find that Claude maintains a small, privileged set of representations it can report on, control, and reason with, atop a much larger volume of automatic processing.
Transformer Circuits
Transformer CircuitsResearchCircuits Updates — June 2026 A short update on turn-averaged sparse autoencoders.
Transformer Circuits
Transformer CircuitsResearchCircuits Updates — May 2026 A short update on understanding features through downstream connections.
Transformer CircuitsResearchNatural Language Autoencoders Produce Unsupervised Explanations of LLM Activations We train Claude to translate its internal state into natural language.
Transformer Circuits
Transformer CircuitsResearchHeadVis We develop an interactive visualization tool to help us understand the behaviors of attention heads in language models.
Transformer CircuitsResearchEmotion Concepts and their Function in a Large Language Model We find representations of emotion concepts in Claude Sonnet 4.5 and show that they causally influence its outputs.
Transformer Circuits
Transformer CircuitsResearchCircuits Cross-Post — Activation Oracles We train language models to answer questions about their own activations in natural language.
Transformer Circuits
Transformer CircuitsResearchCircuits Updates — November 2025 A short update on harm pressure.
Nothing matches this filter yet.