The letter

One letter a week, starting soon.

The week's signal, what shipped, what is worth running tonight, and the editor's note. No tracking, no ads, nothing else.

We keep your address, your language and the date you joined, nothing else. Every letter has a one-click unsubscribe link that deletes the record.

← Accept All   Archive
Qiita (LLM)Japan

Ryzen AI MAX+ 395でNemotron 3.5 Boltを動かす:ROCm・llama.cppで約30.8 tokens/s

October 16

AMD Ryzen AI MAX+ 395の内蔵GPU、Radeon 8060Sで、NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GBの公式GGUFを動かしました。llama.cppをHIPバックエンドでビルドし、テキスト生成、GPUオフロード、Op...

Models & releasesOpen weightsChips & compute
Read at Qiita (LLM) ↗

Related

More from Qiita (LLM) on Accept All.