下拉刷新
Repository Details
Shared bynavbar_avatar
repo_avatar
HelloGitHub Rating
0 ratings
Unlocking the Compute Power of RTX 30 Series GPUs
Claim
Collect
Share
20k
Stars
No
Chinese
C
Language
Yes
Active
9
Contributors
139
Issues
No
Organization
None
Latest
2k
Forks
None
License
This is a Linux kernel module that unlocks the FP16/BF16 instruction issue rate of NVIDIA RTX 30 series consumer GPUs to the level of their professional counterparts, significantly boosting matrix operation throughput. For example, the BF16 compute performance of the RTX 3090 Ti can increase from 87.5 to 157.4 TFLOPS, and large model prefill speed improves by 14%–36%. It performs the unlock before the official NVIDIA driver loads, requiring no driver modifications and no need to reapply patches after each driver update.
Included in:
Vol.127
Tags:
GPU
C

Comments

Rating:
No comments yet