下拉刷新
Repository Details
Shared bynavbar_avatar
repo_avatar
HelloGitHub Rating
0 ratings
Microsoft Open-Sources the Deep Learning Training Optimization Library
FreeApache-2.0
Claim
Collect
Share
35.3k
Stars
No
Chinese
Python
Language
Yes
Active
376
Contributors
1k
Issues
Yes
Organization
0.15.3
Latest
4k
Forks
Apache-2.0
License
More
DeepSpeed image
As everyone knows, training large language models (LLM) is a 'time-consuming and costly' task. This project reduces the time and cost required for training by leveraging ZeRO++ technology, which segments the model state onto each GPU, thereby increasing throughput.

Comments

Rating:
No comments yet