Baidu open-sources Wenxin 5.5 Flash Base, a 280B MoE model

Baidu has open-sourced Wenxin 5.5 Flash Base, a mixture-of-experts base model with 280 billion total parameters and 14 billion activated per token, according to Xinhua. The model was pretrained on 33.5 trillion tokens with a 128K-token context, and fine-tuning and inference are said to support contexts up to 1 million tokens. The report gives no license, repository link, benchmark results, or independent verification, so public availability and performance remain unconfirmed.