Repository Details
Shared by
HelloGitHub Rating
0 ratings
A Python Library for Chatting with Large Language Models Anywhere and Anytime
Past 7 days Received 14 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
3.3k
Stars
No
Chinese
Python
Language
Yes
Active
54
Contributors
110
Issues
Yes
Organization
None
Latest
213
Forks
BSD-3-Clause
License
More
This project is an open-source Python library by the PyTorch team, designed to streamline the operation of Large Language Models (LLMs), enabling easy running of LLMs chat applications on platforms like desktops, servers, iOS, and Android. Users can interact with large models directly through the command line or initiate a WebUI for browser-based usage. Additionally, based on the PTE files generated by ExecuTorch, it can generate LLMs chat applications suitable for mobile devices, supporting large models such as Llama 3 and Mistral.
Comments
Rating:
No comments yet