Repository Details
Shared by
HelloGitHub Rating
10.0
1 ratings
The Inference Engine Dedicated to DeepSeek Developed by Redis Creator
Past 7 days Received 85 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周六 | 24,172 | — |
| 周日 | 24,185 | +13 |
| 周一 | 24,207 | +22 |
| 周二 | 24,221 | +14 |
| 周三 | 24,232 | +11 |
| 周四 | 24,243 | +11 |
| 周五 | 24,257 | +14 |
24.3k
Stars
No
Chinese
C
Language
Yes
Active
75
Contributors
854
Issues
No
Organization
None
Latest
2k
Forks
MIT
License
This project is a lightweight local inference engine developed in C by the creator of Redis, specifically designed for the DeepSeek-V4-Flash model. It is not just a simple GGUF runner, but a fully functional independent inference engine that supports hardware acceleration with Metal and CUDA, 2-bit quantization, persistent disk KV cache, HTTP API services, and programming agents, etc.
Comments
Rating:
No comments yet