ICML 2026 Spotlight Rethinking LLM Ensembling from the Perspective of Mixture Models was accepted to ICML 2026 as a Spotlight presentation. Preprint coming soon.