Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters

MarkTechPost
Read the full article
Aleph Alpha launched Kolibri, a bilingual English-German Mixture-of-Experts language model with 78.1B parameters but only 3.46B active per token, supporting up to 1M token context and deployable on single or dual GPUs.

More in LLM & Text Generation

Meta says its new Muse model has reached the AI frontier

The Next Web