Repository Details
Shared by
HelloGitHub Rating
0 ratings
DeepSeek's Open-Source Large Model Inference Framework
Past 7 days Received 304 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周二 | 25,809 | — |
| 周三 | 25,863 | +54 |
| 周四 | 25,904 | +41 |
| 周五 | 25,962 | +58 |
| 周六 | 26,030 | +68 |
| 周日 | 26,073 | +43 |
| 周一 | 26,113 | +40 |
26.1k
Stars
No
Chinese
Python
Language
Yes
Active
5
Contributors
251
Issues
Yes
Organization
None
Latest
3k
Forks
Apache-2.0
License

This project is the high-performance inference framework used for DeepSeek's large-scale online services, providing core capabilities for offline inference and large-scale deployment. It integrates self-developed optimized operators such as FlashMLA, DeepGEMM, and DeepEP, and supports attention data parallelism, MoE expert parallelism, asynchronous scheduling, deterministic sampling, and structured output. It can run on NVIDIA and Huawei Ascend NPUs.
Comments
Rating:
No comments yet