About Me
Bit is exploring the frontier technologies in combination of networking and LLM at Tencent, the Chair of K8S AI Gateway Working Group.
Bit is leading the development of vLLM Semantic Router, an intelligent router for Mixture-of-Models.
As a CNCF Ambassador and Linux Foundation LFAPAC, Bit serves on the Envoy Gateway Steering Committee. He is also the maintainer of multiple projects including: Envoy AI Gateway, vLLM AIBrix, Istio, Kiali, Aeraki-Mesh, and Merbridge, as well as the approver of Higress and MOSN. Additionally, Bit contributes as a Kubernetes Gateway API and Kubernetes Ingress2Gateway reviewer and member of Kubernetes.
Work Experience
AI Networking
TencentAt Tencent Cloud, working at Tencent Kubernetes Engine (TKE) team, focusing on LLM Inference and Container Networking, including:
- LLM Inference: AI Gateway and RDMA.
- Linux Kernel: ipvs, iptables, netfilters.
- Container Network: IPAM, CNI, Kubeproxy, eBPF, NetworkPolicy.
Service Mesh
TencentAt Tencent Cloud, working at Tencent Cloud Mesh (TCM) team, focusing on Service Mesh.
API Gateway
TencentAt Tencent Games, working on API Gateway built with EnvoyProxy and extension with WebAssembly.
Featured Projects
vLLM Semantic Router
Intelligent Router for Mixture-of-Models
View on GitHub →Envoy Gateway
Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway
View on GitHub →Envoy AI Gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
View on GitHub →vLLM AIBrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
View on GitHub →Technologies & Projects
