shimmy

Install command: 
brew install shimmy

Small local inference server with OpenAI-compatible GGUF endpoints

https://github.com/Michael-A-Kuykendall/shimmy

License: MIT

Formula JSON API: /api/formula/shimmy.json

Formula code: shimmy.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon		 sequoia ✅
sonoma ✅
ventura ✅
macOS on
Intel		 sonoma ✅
ventura ✅
Linux ARM64 ✅
x86_64 ✅

Current versions:

stable ✅ 1.2.0
head ⚡️ HEAD

Depends on when building from source:

cmake 4.1.1 Cross-platform make
rust 1.89.0 Safe, concurrent, practical language

Analytics:

Installs (30 days)
shimmy 9
Installs on Request (30 days)
shimmy 9
Build Errors (30 days)
shimmy 0
Installs (90 days)
shimmy 9
Installs on Request (90 days)
shimmy 9
Installs (365 days)
shimmy 9
Installs on Request (365 days)
shimmy 9