The letter

One letter a week, in your inbox.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
Hugging Face BlogLabs

Transformers now runs llama.cpp quants

September 22

We're adding support for running GGUF models efficiently in transformers , so you can use checkpoints sized for your laptop's memory through the familiar transformers APIs.

Models & releasesOpen weightsResearch
Read at Hugging Face Blog ↗

Related

More from Hugging Face Blog on Accept All.