Introducing Mellum2: A 12B Mixture-of-Experts Model by JetBrains

Hugging Face
Read full post
JetBrains has unveiled Mellum2, a 12-billion parameter Mixture-of-Experts (MoE) model designed to enhance AI performance by dynamically activating expert subsets during inference. This architecture aims to improve efficiency and scalability in AI applications.

More in Machine Learning

Machine Learning5 min read

Cohere Debuts Open-Weight 218B Mixture-of-Experts Machine Translation Model

Covered by 2 sources
Machine Learning3 min read

Anthropic caught scientists using Claude to further biological weapon research

Covered by 2 sources
Machine Learning3 min read

China's star AI labs routed user requests to Claude at least 35 million times in the summer: Anthropic

Business Insider