vLLM Semantic Router
The open decision layer for models and compute. Research, open source, models, and product.
Founder · Since 2025
04Projects
Projects
Founder, creator, and maintainer across open AI infrastructure, from service mesh and gateways to Mixture-of-Models.
- Founder · vLLM-SR
- Creator · Elephant Agent · Inferoa
- 11 more as maintainer and reviewer
- Envoy · Istio · Kubernetes
01
Founded
Research, open source, models, and product.
6.4K
GitHub stars
280+
Contributors
121
Open models
1.8M+
Downloads
02
Created
Open agent projects from the Agentic Intelligence Lab.
03
Maintained
Gateways, service mesh, and inference infrastructure, since 2018.
11 projects-
Envoy Gateway
Maintainer
Kubernetes and standalone gateway on Envoy Proxy.
-
Envoy AI Gateway
Maintainer
Provider access, routing, and inference controls.
-
vLLM AIBrix
Maintainer
Cloud-native building blocks for LLM inference.
-
Istio
Maintainer
Connect, secure, and observe services.
-
Kiali
Maintainer
The console for Istio service meshes.
-
Aeraki Mesh
Maintainer
Layer-7 protocols in the service mesh.
-
Merbridge
Maintainer
eBPF-accelerated mesh data paths.
-
Higress
Committer
Cloud-native AI and API gateway.
-
Kubernetes Gateway API
Member & Reviewer
Role-oriented Kubernetes traffic APIs.
-
Ingress2Gateway
Reviewer
From Ingress to Gateway API, converted.
-
Kubernetes WG AI Gateway
Founding chair
Portable AI gateway patterns for Kubernetes.
- Everything else Commits, reviews, and side projects. GitHub · @Xunzhuo