promptfoo

Install command:
brew install promptfoo

Test your LLM app locally

https://promptfoo.dev/

License: MIT

Development: Pull requests

Formula JSON API: /api/formula/promptfoo.json

Formula code: promptfoo.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon
tahoe
sequoia
sonoma
macOS on
Intel
sonoma
Linux ARM64
x86_64

Current versions:

stable 0.120.26

Depends on:

glib 2.86.4 Core application library for C
node 25.8.0 Open-source, cross-platform JavaScript runtime environment
vips 8.18.0 Image processing library
gettext 1.0 GNU internationalization (i18n) and localization (l10n) library
pcre2 10.47 Perl compatible regular expressions library with a new API

Analytics:

Installs (30 days)
promptfoo 444
promptfoo --HEAD 1
Installs on Request (30 days)
promptfoo 444
promptfoo --HEAD 1
Build Errors (30 days)
promptfoo 1
Installs (90 days)
promptfoo 1,306
promptfoo --HEAD 3
Installs on Request (90 days)
promptfoo 1,306
promptfoo --HEAD 3
Installs (365 days)
promptfoo 5,788
promptfoo --HEAD 11
Installs on Request (365 days)
promptfoo 5,788
promptfoo --HEAD 11