Microsoft reveals cutting-edge MAI-Base-2 model with 2T parameters

Microsoft has developed MAI-Base-2, a 2 trillion parameter base language model using mixture of experts architecture, which is up to 12 times more hardware-efficient than leading open-source models. It was trained on 50 trillion tokens including vision data, enhancing its scientific chart understanding.