Quick facts: Promptfoo is an AI compliance vendor founded in 2024 and headquartered in San Francisco, US. Promptfoo is free to use. Profile last verified April 24, 2026, with every claim traceable to a cited public source.
About Promptfoo
Promptfoo is an open-source CLI and library for evaluating LLM prompts, models, RAGs, and agents through automated benchmarks and matrix comparisons, alongside red-teaming for security vulnerabilities like prompt injections, jailbreaks, PII leaks, and insecure tool use. It differentiates via developer-first local execution, CI/CD integration, and modular plugins covering 50+ attack types with community-driven threat intelligence. Targeted at developers and security teams in enterprises (127 Fortune 500 users), it supports self-hosting to avoid vendor lock-in. Enterprise adds collaboration, monitoring, SSO, and compliance dashboards. Acquired by OpenAI in March 2026 for integration into Frontier platform, remains open-source with SaaS/on-prem options.Promptfoo homepagePromptfoo docsPromptfoo pricing
Featured in
Promptfoo is ranked in the following independent collection.
Framework coverage
Promptfoo features
Capabilities Promptfoo markets publicly. Inclusion means the feature is documented on the vendor's site — not that it's best-in-class. Last verified April 24, 2026.
LLM Evaluation
Systematic testing of LLM outputs for correctness, relevance, safety, and consistency using automated scorers, rubrics, or human review.
LLM Red Teaming
Automated adversarial testing of LLMs for jailbreaks, prompt injection, and unsafe outputs.
Prompt Management
Versioning, templating, A/B testing, and deployment workflows for LLM prompts treated as production artifacts.
Industries served
Integrations
Documented by Promptfoo in public product materials.
- OpenAI API
- Anthropic API
- GitHub
- GitLab
- Jenkins
Promptfoo pricing
Contact for pricing
Community (open-source): free with 10k red teaming probes/month; Enterprise/On-Prem: custom pricing via contact sales.Promptfoo pricing
Pros and cons of Promptfoo
Pros
- Open-source core enables local/self-hosted use without vendor lock-in.
- CLI/CI/CD integration suits developer workflows.
- Covers 50+ vulnerability types with modular, customizable red-teaming.
- Used by 127 Fortune 500 companies, battle-tested at scale.
Cons
- Enterprise pricing not publicly listed, requires contact.
- No explicit coverage of specific regulatory frameworks like NIST AI RMF.
- Limited to 10k probes/month in free tier.
- Recent OpenAI acquisition (March 2026) may impact independent roadmap.
Frequently asked
What is the difference between Community and Enterprise?+
Community is free open-source for local use; Enterprise adds team collaboration, monitoring, SSO, API, and custom limits.Promptfoo pricing
Is Promptfoo open-source?+
Yes, the core CLI/library is fully open-source under MIT license, runs locally.Promptfoo docs
What vulnerabilities does it test?+
50+ types including prompt injection, jailbreaks, PII exposure, hate speech, insecure tool use.Promptfoo homepage
Can it run in CI/CD?+
Yes, integrates with GitHub, GitLab, Jenkins, and other pipelines.Promptfoo docs
Post-acquisition by OpenAI?+
Team joined OpenAI, technology integrated into Frontier; remains open-source.CNBC
Sources
Keep reading
See an error or outdated detail?
Profiles carry a last-verified date. If something is out of date or wrong, send a correction and we will review it.
Work at Promptfoo?
Claim this listing to propose edits to the tagline, description, pricing notes, and headquarters details. Every change is still reviewed by our editorial team.