ByteDance Trains 10 Trillion-Parameter AI Model to Rival Anthropic
Updated
Updated · Ars Technica · Aug 7
ByteDance Trains 10 Trillion-Parameter AI Model to Rival Anthropic
3 articles · Updated · Ars Technica · Aug 7
Summary
ByteDance is pre-training an AI model with as many as 10 trillion parameters, a scale that would make it one of the world’s largest if the project reaches release.
Three people familiar with the effort said the model is still in an early pre-training phase that typically lasts three to six months, with the final size to be set later before fine-tuning.
At 10 trillion parameters, the system would be about three times larger than Moonshot’s Kimi K3, now the biggest Chinese model released, and could exceed industry estimates for Anthropic’s 8 trillion-parameter Mythos 5.
The push underscores how Chinese labs are closing on top US rivals: recent models from Moonshot and Alibaba have posted strong benchmark results, while several Chinese groups are already training systems around Anthropic’s Fable 5 scale.