Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Speculative decoding and prefix caching benchmarked, plus DFlash 2 — the only Qwen3.8-27B build that can serve it under vLLM.
A local AI engine and server for one NVIDIA DGX Spark. It serves Qwen3.8-27B and Qwen3.8-Flash-Next with its own NVFP4 and EXL3 kernels, draft trees sized by StairCut, and caches that survive a restart. OpenAI-compatible API, chat, dashboard and a setup guide.