Repository Details
Shared by
HelloGitHub Rating
0 ratings
Beginner-Friendly LLM Fine-Tuning Toolkit
Past 6 days Received 246 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周日 | 79,203 | — |
| 周一 | 79,252 | +49 |
| 周二 | 79,295 | +43 |
| 周三 | 79,337 | +42 |
| 周四 | 79,395 | +58 |
| 周五 | 79,449 | +54 |
79.4k
Stars
No
Chinese
Python
Language
Yes
Active
450
Contributors
512
Issues
Yes
Organization
None
Latest
7k
Forks
Apache-2.0
License

This project is a Python toolkit for fine-tuning and optimizing large language models (LLMs). It enhances the speed of model fine-tuning through dynamic quantization and memory optimization techniques, while reducing GPU memory usage by 70%-80%. It supports a variety of hardware configurations, LLMs, and ultra-long context tasks. In addition, it provides Jupyter Notebook examples that can be experienced online directly, lowering the barrier to entry for fine-tuning large models.
Comments
Rating:
No comments yet