shimmy

Install command: 
brew install shimmy

Small local inference server with OpenAI-compatible GGUF endpoints

https://github.com/Michael-A-Kuykendall/shimmy

License: MIT

Formula JSON API: /api/formula/shimmy.json

Formula code: shimmy.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon		 tahoe ✅
sequoia ✅
sonoma ✅
macOS on
Intel		 sonoma ✅
Linux ARM64 ✅
x86_64 ✅

Current versions:

stable ✅ 1.5.6
head ⚡️ HEAD

Depends on when building from source:

cmake 4.1.2 Cross-platform make
rust 1.90.0 Safe, concurrent, practical language

Analytics:

Installs (30 days)
shimmy 205
shimmy --HEAD 1
Installs on Request (30 days)
shimmy 205
shimmy --HEAD 1
Build Errors (30 days)
shimmy 0
Installs (90 days)
shimmy 205
shimmy --HEAD 1
Installs on Request (90 days)
shimmy 205
shimmy --HEAD 1
Installs (365 days)
shimmy 205
shimmy --HEAD 1
Installs on Request (365 days)
shimmy 205
shimmy --HEAD 1