The letter

One letter a week, starting soon.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
llama.cpp releasesTools

b11626: model: split layers evenly when no device reports free memory (#29677)

October 14

When every device reports zero free memory the split points are normalized by a zero sum, the NaN split sends layers to a device index past the end and loading aborts with vector::_M_range_check.

Read at llama.cpp releases ↗

More from llama.cpp releases on Accept All.