ds4
Open-source Metal-first inference engine for Apple Silicon with adaptive SSD streaming. - andreaborio/hebrus
Take a look →OPEN SOURCE, IN FOCUS
llama.cpp-adaptive-kv-streaming
raymondhuang210129/llama.cpp-adaptive-kv-streaming
LLM inference in C/C++.
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
Start with the source.
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Keep exploring
Find projects in the same areas, or search the archive for a different approach.