On July 31, Huawei officially open-sourced the large model openPangu-2.0-Pro under the openPangu AI model brand openPangu, along with model weights, basic inference code, and technical reports, further promoting the construction of the Ascend AI ecosystem and providing best practices for developers and enterprises based on native Ascend training and inference technologies.

According to the information, openPangu-2.0-Pro is a large-scale Mixture of Experts (MoE) language model trained on Ascend NPU, with a total parameter scale of approximately 505B (505 billion), about 18B parameters activated per token, supporting a context length of 512K, and a training data size of about 34T Tokens. In the post-training phase, the model completed supervised fine-tuning (SFT) with fast and slow integration, multiple specialized reinforcement learning (RL), and achieved capability fusion through online distillation (OPD), further enhancing its overall performance.

QQ20260731-105624.jpg

This open-source release is an important part of Huawei's openPangu 2.0 open-source plan. At the HDC 2026 Developer Conference held in June, Huawei Executive Director, Chairman of the Product Investment Review Committee, and President of the Terminal BG, Yu Chengdong, announced that openPangu 2.0 would gradually open-source seven key components starting from June 30, including pre-training code, post-training code, and training operators. Previously, the 92B-parameter openPangu-2.0-Flash model was released first on June 30.

Regarding the total parameter scale of openPangu-2.0-Pro being 505B, Yu Chengdong stated that Huawei will allocate a large amount of AI computing resources to support the domestic industry ecosystem. However, Huawei's available computing power is relatively limited, and AI training costs continue to be high. Therefore, Huawei pays more attention to optimizing the model's efficiency in terms of latency and throughput. As openPangu 2.0 continues to open up core models and training capabilities, the Ascend-native AI development ecosystem is expected to be further improved and provide more open-source references for the development of domestic large models.

Ascend Tribe Open Source Community: https://www.huaweicloud.com/product/modelarts/studio