vllm-gfx906-mobydick
A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
Take a look →OPEN SOURCE, IN FOCUS
renning22/glm-5.2-4090
First known correct serving of GLM-5.2 (DeepSeek-Sparse-Attention) on consumer RTX 4090 GPUs — a portable Ada/sm_89 port of the DSA kernel stack.
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Find projects in the same areas, or search the archive for a different approach.