HN · GitHub Signals

OPEN SOURCE, IN FOCUS

gsq

ist-daslab/gsq

Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).

Explore on GitHub ↗

Saved projects stay in this browser. No account needed.

TAKE A CLOSER LOOK

Start with the source.

The repository is the place to check installation steps, supported platforms, the license, and current maintenance before choosing a tool.

Read the documentation on GitHub ↗

Keep exploring

Find projects in the same areas, or search the archive for a different approach.

ANOTHER GOOD FIND

Explore related projects

View the archive ↗

Connected by topics and descriptions.

intelchina-ai

bittern

Making 1.58-bit models simple to build and broadly accessible through low-cost, high-accuracy post-training ternary quantization.

Take a look →
0xbakeer

qwen3.8-27b-4-bit-on-a-single-dgx-spark

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.

Take a look →
aiksa2090

agentic-swarm

🧠 Multi-Agent AI System running 100% offline using Google Gemma-4 models. 5 specialized AI agents collaborate in infinite loops for brainstorming. Features: Dynamic VRAM swapping, 4-bit NF4 quantization, WhatsApp-style RTL UI, live token streaming, AI-powered agent customization. Built with PySide6 + PyTorch + Transformers.

Take a look →
continuum-ai-corp

orcabonsai-27b-uncensored

Runtime behavioral ablation for compressed LLMs. First target: Ternary Bonsai 2 27B — no weight modification or re-quantization. by OrcaRouter team

Take a look →