下拉刷新
Repository Details
Shared bynavbar_avatar
repo_avatar
HelloGitHub Rating
0 ratings
Unlocking the Compute Power of RTX 30 Series GPUs
Claim
Collect
Share
11.2k
Stars
No
Chinese
C
Language
Yes
Active
8
Contributors
199
Issues
No
Organization
None
Latest
1k
Forks
None
License
More
This is a Linux kernel module that unlocks the FP16/BF16 instruction issue rate of NVIDIA RTX 30 series consumer GPUs to the level of their professional counterparts, significantly boosting matrix operation throughput. For example, the BF16 compute performance of the RTX 3090 Ti can increase from 87.5 to 157.4 TFLOPS, and large model prefill speed improves by 14%–36%. It performs the unlock before the official NVIDIA driver loads, requiring no driver modifications and no need to reapply patches after each driver update.
Included in:
Vol.127
Tags:
GPU
C

Comments

Rating:
No comments yet