/
← Accept All   Archive
Hacker News ShowGitHub

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

September 1Work

I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/updat

Models & releases
Read at Hacker News Show ↗

Related

More from Hacker News Show on Accept All.