Huawei, the Chinese tech giant, is preparing to launch “PanGu Chat,” a new multimodal large-scale model that directly competes with OpenAI’s ChatGPT. The official launch and internal testing of PanGu Chat are scheduled for July 7th at the Huawei Cloud Developer Conference. This model targets enterprise customers in the B2B and B2G sectors.
Features and Capabilities of PanGu Chat: A Trillion-Parameter Powerhouse
PanGu-Σ model is developed within Huawei’s MindSpore framework and boasts an impressive 1.085 trillion parameters, comparable to OpenAI’s GPT-3.5 in terms of conversational capabilities. It is an extension of Huawei’s PanGu model, which was introduced in 2021 and upgraded to version 2.0 in 2022. The PanGu model includes modules for NLP, CV, multimodal, and scientific computing models.
The PanGu NLP model utilizes an Encoder-Decoder architecture, combining understanding and generation capabilities for flexibility in different systems. It can be fine-tuned with minimal data and learnable parameters, making it suitable for quick deployment in applications such as intelligent public opinion analysis and marketing.
The PanGu CV model is the industry’s largest and supports on-demand extraction. It excels in intelligent inspection and smart logistics, with improved small-sample learning capabilities and leading performance in the industry.
Huawei’s PanGu meteorological model offers real-time weather forecasting with high accuracy, surpassing traditional methods. It utilizes innovative network structures and algorithms to reduce errors in typhoon path prediction.
Training the PanGu model involves over 2,000 Ascend 910 chips and takes more than two months. Huawei has invested substantial resources, including 4,000 GPU/TPU cards and a total cost of 960 million Chinese yuan over three years, to support the model’s development.
Experts predict that Huawei’s PanGu model, with its significant computing power and talent pool, will establish itself as a leading model in China. The PanGu ecosystem is expected to experience rapid development, benefiting Huawei’s ecosystem companies and empowering various industries with advanced capabilities.
(Via)