Xunzhuo Liu

Reshape the Networking in Cloud & AI

GitHub
Banner image
feature image

About Xunzhuo Liu (BIT)

Bit is exploring the frontier technologies in combination of networking and LLM at Tencent Kubernetes Engine team. He is currently working on everthing around AI Infrastructure. Previously, he has been involved in NLP research at UESTC NLP Lab.

Bit is leading the development of vLLM Semantic Router, an intelligent auto reasoning router for Efficient LLM Inference on Mixture-of-Models, saving tons of cost by advanced routing algorithm.

As a CNCF Ambassador and Linux Foundation LFAPAC, Bit serves on the Envoy Gateway Steering Committee. He also leads multiple projects including Envoy AI Gateway , vLLM AIBrix , Istio , Kiali , Aeraki-Mesh , and Merbridge , as well as the approver of Higress and MOSN . Additionally, Bit contributes as a Kubernetes Gateway API and Kubernetes Ingress2Gateway reviewer and member of Kubernetes.

  • Open Source Enthusiast: CNCF Ambassador, Linux Foundation Evangelist
  • Technical Expert: Focusing on AI Gateway, LLM Inference, Kubernetes Networking.
  • Projects Lead: Leading products like Envoy Gateway, Envoy AI Gateway, vLLM AIBrix.
  • Life Adventurer: Guitar Player, Fitness Enthusiast, Traveler, Film Fan
Linkedin