The letter

One letter a week, in your inbox.

The signal of the week, what shipped, what to try, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
Transformer CircuitsResearch

Characterizing interference weights in a tiny language model

August 21

We identify interference weights in a 1-layer transformer by measuring their effect on model outputs and loss.

Models & releasesnote
Read at Transformer Circuits ↗

Related

More from Transformer Circuits on Accept All.