luce-org/lucebox-hub
Fast LLM speculative inference server for consumer hardware. - Luce-Org/lucebox-hub
Unlock True LLM Performance on Your Consumer Hardware
Published 131d ago§ Repository
luce-org/lucebox-hub
Fast LLM speculative inference server for consumer hardware. - Luce-Org/lucebox-hub
- llm inference
- optimization
- consumer hardware
- machine learning