The letter

One letter a week, starting soon.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
Apple Machine Learning ResearchResearch

Attention to Mamba: A Recipe for Cross-Architecture Distillation

11.03

State Space Models (SSMs) such as Mamba have become a popular alternative to Transformer models, due to their reduced memory consumption and higher throughput at generation compared to their…

Research
Read at Apple Machine Learning Research ↗

Related

More from Apple Machine Learning Research on Accept All.