vLLM and SGLang add day-zero support for new Xiaomi and GLM models

01 — inference 3 VOICES

vLLM and SGLang add day-zero support for new Xiaomi and GLM models

vLLM has rolled out day-zero support for Xiaomi's MiMo-V2.6 model family, spanning a 1.02T total parameter Pro version and a 309B parameter Flash checkpoint. Additionally, disaggregated setups achieved 469 tok/s single-user decode performance using vLLM on AMD hardware.

3 independent accounts 21 posts 2 labs 7,112 interactions

vllmsglang

@AravSrinivas

@teortaxesTex

@vllm_project

@PyTorch

@SemiAnalysis_

@XiaomiMiMo

@aiDotEngineer

@googlegemma

Being discussed

vLLM and SGLang add day-zero support for new Xiaomi and GLM models