Tencent Releases Open-Source Hy4 Preview AI Model With 770 Billion Parameters

Tencent has released a preview version of a new open-source artificial intelligence model called Hy4 preview, aimed at tasks such as software engineering, research and financial analysis, the Chinese technology company said in a post on Hugging Face, a repository for open-source AI models, on Friday.

The model uses a 'mixture-of-experts' design, meaning it is built from many smaller specialised sub-networks and activates only the ones relevant to a given request. Hy4 preview has 770 billion parameters in total — the internal values a model adjusts during training — but only about 49 billion of them are used for any single text request, Tencent said.

Tencent said it plans to integrate the model into its own products, including CodeBuddy and WorkBuddy. The company acknowledged that the early-release model can sometimes take longer than necessary to work through complex questions and may over-verify its own answers.

The release comes as Tencent increases its investment in AI in an increasingly crowded market. The company unveiled a large language model called Hunyuan 3.0 in April, its first major release since hiring former OpenAI researcher Yao Shunyu to lead its AI platform development.