Repository Details
Shared by
HelloGitHub Rating
0 ratings
A Python Library for Chatting with Large Language Models Anywhere and Anytime
Past 6 days Received 1 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
3.6k
Stars
No
Chinese
Python
Language
Yes
Active
67
Contributors
94
Issues
Yes
Organization
None
Latest
246
Forks
BSD-3-Clause
License
More

This project is an open-source Python library by the PyTorch team, designed to streamline the operation of Large Language Models (LLMs), enabling easy running of LLMs chat applications on platforms like desktops, servers, iOS, and Android. Users can interact with large models directly through the command line or initiate a WebUI for browser-based usage. Additionally, based on the PTE files generated by ExecuTorch, it can generate LLMs chat applications suitable for mobile devices, supporting large models such as Llama 3 and Mistral.
Comments
Rating:
No comments yet