GITHUB SIGNALS / PROJECT INDEX

Find your next great tool.

Search the archive. Follow your curiosity. Keep the projects you want to come back to.

24 projects

OPEN SOURCE

jakeatx/llamampere

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): TurboQuant KV cache, MTP speculative decoding with a 64K draft-vocabulary shortlist, custom SM86 + Qwen kernels. 90 tok/s over a 100K-token generation at temperature 1.