Repository Details
Shared by


HelloGitHub Rating
0 ratings
A Python Library for Chatting with Large Language Models Anywhere and Anytime
Past 6 days Received 1 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
3.6k
Stars
No
Chinese
Python
Language
Yes
Active
68
Contributors
93
Issues
Yes
Organization
None
Latest
249
Forks
BSD-3-Clause
License
More

This project is an open-source Python library by the PyTorch team, designed to streamline the operation of Large Language Models (LLMs), enabling easy running of LLMs chat applications on platforms like desktops, servers, iOS, and Android. Users can interact with large models directly through the command line or initiate a WebUI for browser-based usage. Additionally, based on the PTE files generated by ExecuTorch, it can generate LLMs chat applications suitable for mobile devices, supporting large models such as Llama 3 and Mistral.
Comments
Rating:
No comments yet