sglang-rtxpro6000
Personal Optimized SGLang runtime for Qwen3.8-27B/DFlash2 and Qwen3.8 Flash-Next on one RTX PRO 6000 Blackwell (SM120).
Take a look →OPEN SOURCE, IN FOCUS
ninfer-all
iamwavecut/ninfer-all
One line of NInfer for the RTX 3090, RTX 4090 and RTX 5090, consolidated from the forks that carry it: GGUF block formats, ternary Bonsai 2, device route profiles, MTP and DFlash2.
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
Start with the source.
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Keep exploring
Find projects in the same areas, or search the archive for a different approach.