Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters

Aleph Alpha launched Kolibri, a bilingual English-German Mixture-of-Experts language model with 78.1B parameters but only 3.46B active per token, supporting up to 1M token context and deployable on single or dual GPUs.