promptfoo

Install command:
brew install promptfoo

Test your LLM app locally

https://promptfoo.dev/

License: MIT

Development: Pull requests

Formula JSON API: /api/formula/promptfoo.json

Formula code: promptfoo.rb on GitHub

Bottle (binary package) installation support provided for:

macOS on
Apple Silicon
tahoe
sequoia
sonoma
macOS on
Intel
sonoma
Linux ARM64
x86_64

Current versions:

stable 0.120.24

Depends on:

glib 2.86.3 Core application library for C
node 25.6.0 Open-source, cross-platform JavaScript runtime environment
vips 8.18.0 Image processing library
gettext 1.0 GNU internationalization (i18n) and localization (l10n) library

Analytics:

Installs (30 days)
promptfoo 534
promptfoo --HEAD 1
Installs on Request (30 days)
promptfoo 534
promptfoo --HEAD 1
Build Errors (30 days)
promptfoo 11
Installs (90 days)
promptfoo 1,447
promptfoo --HEAD 6
Installs on Request (90 days)
promptfoo 1,447
promptfoo --HEAD 6
Installs (365 days)
promptfoo 5,770
promptfoo --HEAD 11
Installs on Request (365 days)
promptfoo 5,770
promptfoo --HEAD 11