sipp
AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to run GGUF models directly in the browser. Features a symmetric API for seamless local execution and cloud provider routing. Built with Rust & C++.
Take a look →OPEN SOURCE, IN FOCUS
camenduru/tostui
This project is a collection of Docker-based web user interfaces designed to easily run various state-of-the-art generative AI models locally. It simplifies the deployment of these AI tools by packaging them into ready-to-use containers with accessible front-end controls.
Saved projects stay in this browser. No account needed.
TAKE A CLOSER LOOK
The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.
Read the documentation on GitHub ↗Find projects in the same areas, or search the archive for a different approach.