The letter

One letter a week, starting soon.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
vLLM BlogTools

Inkling 2 Small on vLLM: Day-0 Support

11.12

vLLM supports Thinking Machines' Inkling 2 Small from day 0: attention residuals, a new decode kernel for relative-bias attention, all-reduce fused with the ops around it, and DSpark speculative…

Open weightsmodel-supportperformancemultimodalspeculative-decoding
Read at vLLM Blog ↗

Related

More from vLLM Blog on Accept All.