This is a Python library that drastically reduces inference VRAM usage via hierarchical loading. It can run 70B large models with only 4GB VRAM without quantization, distillation, or pruning. It supports mainstream models such as Llama 3.x, Qwen3, DeepSeek, and offers prefetch acceleration, 8bit/4bit quantization, and macOS support.