Promptfoo: pricing and features
by Promptfoo (now part of OpenAI)
Prices and features checked 2026-10-17 on the vendor's own pages. Anything we could not confirm says “not verified”.
What is Promptfoo? Open-source CLI for testing prompts, agents and RAG apps from YAML configs, with model-graded assertions, CI integration and red-teaming. Enterprise adds team features and a managed or on-prem deployment.
Best for: Developers who want config-driven prompt and model tests plus red-teaming that run locally and in CI.
Pricing
- Free tier
- Community: free, all LLM evaluation features, red teaming up to 10k probes/month [source, checked 2026-10-17]
- Entry paid price
- Enterprise: custom pricing (no public price) [source, checked 2026-10-17]
- What you pay for (meter)
- Red-team probes (10k/month free); Enterprise priced on team size and needs [source]
- Licence
- MIT [source]
- Self-hosting
- Run locally or self-host; on-premise Enterprise tier [source]
- Data retention
- not verified
Features
| OpenTelemetry | OpenTelemetry tracing in evaluations [source] |
|---|---|
| CI gating | CI/CD integration in the free Community version [source] |
| LLM-as-judge | Model-graded assertions (rubrics, faithfulness, relevance) [source] |
| Human annotation | not verified |
| Prompt management | not verified |
| Dataset versioning | not verified |
| SOC 2 / HIPAA | not verified |
More on Promptfoo
Our directory entry covers what Promptfoo tests, its licence and how to run it: Promptfoo on Evals Review.
Compare
- All 12 LLM evaluation platforms compared
- Promptfoo vs DeepEval / Confident AI
- Langfuse alternatives
- LangSmith alternatives
- Braintrust alternatives
- Arize AX and Phoenix alternatives
- Pricing calculator · LLM observability tools
Other tools: Langfuse · Braintrust · LangSmith · Arize AX and Phoenix · DeepEval and Confident AI · Galileo (Splunk Agent Observability) · Maxim AI · Helicone · Comet Opik · W&B Weave · Ragas