Open Source Projects with the 推理框架 Topic - HelloGitHub

下拉刷新

推理框架

Topic

uzu—High-performance AI Inference Engine Exclusive to MacBook

This is a high-performance and lightweight AI model inference engine specifically designed for Apple

·Rust·3 months ago

nano-vllm—Lightweight vLLM Built from Scratch

This project is a lightweight vLLM (large language model inference engine) implemented in Python. Th

·Python·4 months ago

BitNet—Microsoft's Open-Source 1-bit Large Model Inference Framework
1

This is an inference framework designed by Microsoft specifically for CPU-based local inference and

·Python·6 months ago

- That's all for now, only these are available at the moment -

Recommend

Refresh