GITHUB SIGNALS / PROJECT INDEX

Find your next great tool.

Search the archive. Follow your curiosity. Keep the projects you want to come back to.

24 projects

OPEN SOURCE

turbo-tan/llama.cpp-tq3

llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired Walsh-Hadamard transform. Enables 27B models on 16GB GPUs with 15 tok/s TG, 221 tok/s PP.