shimmy

Install command:
brew install shimmy

Small local inference server with OpenAI-compatible GGUF endpoints

https://github.com/Michael-A-Kuykendall/shimmy

License: Apache-2.0

Development: Pull requests

Formula JSON API: /api/formula/shimmy.json

Formula code: shimmy.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon
tahoe
sequoia
sonoma
Linux ARM64
x86_64

Current versions:

stable 2.6.4
head ⚡️ HEAD

Depends on when building from source:

cmake 4.4.3 Cross-platform make
rust 1.98.1 Safe, concurrent, practical language

Uses from macOS: llvm (build)

Binaries: create_realistic_safetensors, create_test_safetensors, shimmy, test_real_safetensors

Service:

Start now and at login: brew services start shimmy
Run directly: $HOMEBREW_PREFIX/opt/shimmy/bin/shimmy serve --bind 127.0.0.1:11435

Analytics:

30 days90 days365 days
Installs67142690
Installs (--HEAD)002
Installs on Request67142690
Installs on Request (--HEAD)002
Build Errors0