Baidu Releases ERNIE 5.5 Flash Base for Further Training

Baidu released ERNIE-5.5-Flash-Base, a 280B-parameter text-only mixture-of-experts model checkpoint for further training and research. It supports up to 1 million token context and includes novel sparse attention and expert routing techniques.