Show HN: 35B MoE LLM and other models locally on an old AMD crypto APU (BC250)
Hi HN, I put together some info on repurposing the AMD BC-250, an APU (Zen 2 + RDNA 1.5 "Cyan Skillfish") originally made for blockchain appliances. They've been showing up on AliExpress for around $150. Since it's an unusual hybrid chip (GFX1013), I ended up…
GPU-accelerated AI home server on an obscure AMD APU Vulkan inference, autonomous intelligence, Signal chat Zen 2 · RDNA 1.5 · 16 GB unified · Vulkan · 14B @ 27 tok/s · 330 autonomous jobs/cycle · 1… [+92961 chars]