Open Source Projects with the 推理框架 Topic - HelloGitHub

下拉刷新

推理框架

Topic

vllm-omni—Multimodal Model Inference Framework

This project is an open-source multimodal inference and serving framework officially released by vLL

·Python·16 days ago

uzu—High-performance AI Inference Engine Exclusive to MacBook

This is a high-performance and lightweight AI model inference engine specifically designed for Apple

·Rust·a year ago

nano-vllm—Lightweight vLLM Built from Scratch

This project is a lightweight vLLM (large language model inference engine) implemented in Python. Th

·Python·a year ago

BitNet—Microsoft's Open-Source 1-bit Large Model Inference Framework
1

This is an inference framework designed by Microsoft specifically for CPU-based local inference and

·Python·a year ago

- That's all for now, only these are available at the moment -

Recommend

Refresh