01 / MACHINE INTELLIGENCE

AI & machine learning

Models you can run. Agents you can inspect. Tools you can build on.

← All topics

24 projects

OPEN SOURCE

jakeatx/llamampere

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): TurboQuant KV cache, MTP speculative decoding with a 64K draft-vocabulary shortlist, custom SM86 + Qwen kernels. 90 tok/s over a 100K-token generation at temperature 1.