The letter

One letter a week, starting soon.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
llama.cpp releasesTools

b12227: tests : keep dummy ffn.act scales away from zero (#31940)

11.09

The dummy-model generator fills every tensor from a plain normal pool. blk.N.ffn.act.scales is a divisor in the mpt graph, so with seed 1224489258 it draws |v| ~ 1e-6, and ffn_act = gelu(...) /…

Read at llama.cpp releases ↗

More from llama.cpp releases on Accept All