macaq
SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
Take a look →OPEN SOURCE, IN FOCUS
adventists-ai/sophon-realtime
Sophon-Realtime v1: open full-duplex voice models that hear your tone and speak with one. Tag and Flash run on one GPU with vLLM-Omni; E2E in preview.
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Find projects in the same areas, or search the archive for a different approach.