beellama.cpp
DFlash & TurboQuant in llama.cpp with up to 3x faster generation and 7.5x more KV cache in same VRAM
Take a look →OPEN SOURCE, IN FOCUS
actypedef/sharq
Code for the paper “SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference”
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Find projects in the same areas, or search the archive for a different approach.