fastmix
[ICLR-2026] The PyTorch Implementation of FastMix. The algorithms are based on our paper: "Fast Data Mixture Optimization via Gradient Descent". FastMix is designed to rapidly identify optimal data mixing ratios for large language models (LLMs). - GitHub - hrtan/fastmix: [ICLR-2026] The PyTorch Implementation of FastMix. The algorithms are based on our paper: "Fast Data Mixture Optimization via Gradient Descent". FastMix is designed to rapidly identify optimal data mixing ratios for large language models (LLMs).
Take a look →