§ Repository

the-school-of-ai/llm

LightningLM 0.1V — Reference training pipeline for the LightningLM family. 2B dense seed → 5B MoE → 9B MoE → 120B sparse MoE through TurboQuant-PreTraining on a single eight-GPU node. Companion code for *Reversible Foundations*. - The-School-of-AI/LLM

• ★54 stars
• 2 posts
• Latest: 2026-06-08

• AI / coding agent
• machine learning
• large language models
• training pipeline
• mixture of experts
• model quantization