🏢 Pretraining infra engineer at Baidu BMU, and owner of the optimizer infra for ERNIE.
⚙️ Focus on optimizers: bringing new optimizers (e.g. Muon-style orthogonalized updates) into distributed training, and making them fast — sharded optimizer states, fused kernels, checkpoint save / load / resharding.
🚀 Also work on distributed performance in general: parallel strategies, communication overlap, and squeezing more throughput out of every GPU.
🔍 Enjoy digging into where the time and memory actually go — from the math of an update rule down to the communication pattern.
🍚 Life motto: 事已至此，先吃饭吧 — it is what it is, let's eat first.

• ⚡ paddle.optimizer.Muon — the Muon optimizer in PaddlePaddle: Newton–Schulz orthogonalized momentum updates for 2D weight matrices, with AdamW handling the rest (source).
• 🧩 MuonShardingOptimizer — sharding-stage-1 support for Muon in Paddle Fleet: whole matrices are assigned to owner ranks so orthogonalization stays local, while the remaining parameters are sharded element-wise.

• 🏢 Baidu, BMU Pretraining Infra — Optimizer Infra Owner for ERNIE · 2025 – Present

• 🎓 The Hong Kong University of Science and Technology (Guangzhou) — MPhil, Data Science and Analytics (DSA) Thrust · 2023 – 2025
• 🎓 China University of Petroleum, Beijing — B.Eng. in Computer Science and Technology · 2019 – 2023