JustVugg/colibri
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
- Stars
- 51,214
- Forks
- 6,175
- Watchers
- 403
- Stars, 24 hours
- +260
- Stars, 7 days
- +2,367
LicenseApache-2.0: YesFree to use at work. Keep the notices and say what you changed.Not legal advice
Numbers as of 15 Nov 2026, 10:00 UTC
Get it
- Windows
- macOS
- Linux
Health
87 out of 100Active
- Issues
- 552 closed / 95 open
- Pull requests
- 1,778 merged / 92 open
- Commits, last 90 days
- 3,688
- Latest release
- 31 Oct 2026 (21 in all)
Checked 14 Nov 2026
Other options for the same problem
Growth
7 days: +2,390 stars30 days: +3,657 stars
Add a badge to your README
Get badge
Add this to your README. More about badges.