shimmy

Install command:
brew install shimmy

Small local inference server with OpenAI-compatible GGUF endpoints

https://github.com/Michael-A-Kuykendall/shimmy

License: Apache-2.0

Development: Pull requests

Formula JSON API: /api/formula/shimmy.json

Formula code: shimmy.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon
golden gate ✅
tahoe ✅
sequoia ✅
sonoma ✅
Linux ARM64 ✅
x86_64 ✅

Current versions:

stable ✅ 2.6.4
head ⚡️ HEAD

Depends on when building from source:

cmake 4.4.4 Cross-platform make
rust 1.99.0 Safe, concurrent, practical language

Uses from macOS: llvm (build)

Binaries: create_realistic_safetensors, create_test_safetensors, shimmy, test_real_safetensors

Service:

Start now and at login: brew services start shimmy
Run directly: $HOMEBREW_PREFIX/opt/shimmy/bin/shimmy serve --bind 127.0.0.1:11435

Analytics:

30 days90 days365 days
Installs9139518
Installs (--HEAD)001
Installs on Request9139518
Installs on Request (--HEAD)001
Build Errors0