π° Reame β live CPU LLM demo
A CPU-first inference server on llama.cpp, serving OLMoE (7B MoE, 1B
active) from a free Oracle ARM box. Source & benchmarks β
A 7B MoE runs fast on CPU (~25 tok/s here) β most answers land in a
few seconds. This is a demo, not a benchmark.
checking backendβ¦