Repository Details
Shared by
HelloGitHub Rating
0 ratings
Tutorial on Implementing Llama 3 from Scratch
Past 7 days Received -6 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周二 | 15,199 | — |
| 周三 | 15,197 | -2 |
| 周四 | 15,196 | -1 |
| 周五 | 15,193 | -3 |
| 周六 | 15,194 | +1 |
| 周日 | 15,193 | -1 |
| 周一 | 15,193 | 0 |
15.2k
Stars
No
Chinese
Jupyter Notebook
Language
No
Active
1
Contributors
24
Issues
No
Organization
None
Latest
1k
Forks
MIT
License

This project helps people deeply understand how Large Language Models (LLMs) work by building Llama 3 layer by layer. The author uses the PyTorch framework to implement loading model weights, text tokenization, model configuration, and step-by-step implementation of key components in the Transformer model.
Comments
Rating:
No comments yet