Hunyuan-A13B Technical Report

This technical report presents Hunyuan-A13B, an open-source Mixture-of-Experts language model containing 80 billion total parameters while activating only 13 billion during inference. Pretrained on a 20T-token corpus with enhanced STEM curation, the model incorporates a dual-mode Chain-of-Thought framework that adapts reasoning depth to task complexity. Evaluations demonstrate competitive performance across diverse domains and high inference throughput, making it suitable for latency-sensitive applications.

It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost.

The model is pretrained on a rigorously filtered 20T-token corpus with enhanced STEM data curation, improving factual reliability and reasoning ability.