Repository Details
Shared by
HelloGitHub Rating
0 ratings
AI Model Inference Platform on K8s
Past 7 days Received 26 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周三 | 6,188 | — |
| 周四 | 6,192 | +4 |
| 周五 | 6,197 | +5 |
| 周六 | 6,199 | +2 |
| 周日 | 6,201 | +2 |
| 周一 | 6,209 | +8 |
| 周二 | 6,214 | +5 |
6.2k
Stars
No
Chinese
Go
Language
Yes
Active
399
Contributors
290
Issues
Yes
Organization
None
Latest
2k
Forks
Apache-2.0
License

This project is a K8s-based AI inference platform that supports the vLLM backend and OpenAI-compatible APIs. It can deploy models built with various frameworks, including TensorFlow, PyTorch, scikit-learn, and ONNX, and offers features such as autoscaling, canary releases, and model monitoring.
Comments
Rating:
No comments yet