This project is a lightweight local inference engine developed in C by the creator of Redis, specifically designed for the DeepSeek-V4-Flash model. It is not just a simple GGUF runner, but a fully functional independent inference engine that supports hardware acceleration with Metal and CUDA, 2-bit quantization, persistent disk KV cache, HTTP API services, and programming agents, etc.