Patronus AI vs Promptfoo

Patronus AI was founded in 2023 by Anand Kannappan (CEO) and Rebecca Qian (CTO), who both previously worked on AI at Meta, and is based in San Francisco. It launched in September 2023 as an LLM evaluation company for regulated industries. It raised a $3 million seed round led by Lightspeed Venture Partners, then a $17 million Series A led by Notable Capital in May 2024. In June 2026 it raised a $50 million Series B led by Greenfield Partners, with Lightspeed, Notable Capital, Datadog and Samsung, bringing its total to $70 million. **What it sells now** Its homepage now says: "Patronus AI is a research lab developing training data and simulated environments for frontier AI." The products page offers Frontier Training Data: tasks with reference solutions and graders, and ready-built or custom simulated environments for software development, computer use and knowledge work, delivered to run in a lab's own training infrastructure. In December 2025 it launched Generative Simulators and RL Environments, which generate tasks and rules and adapt them as an agent learns. In June 2026 it announced Digital World Models, replicas of websites and company systems where agents can practice. Patronus says most leading frontier labs and hyperscalers are customers but names none, and it reports revenue growth of more than 15 times over the past year. **The evaluation platform** Patronus's documentation still describes the evaluation product the company started with. It includes an API and SDK with off-the-shelf evaluators (among them Lynx for hallucination detection and the small Glider evaluator model), custom evaluators, experiments, logs, tracing and Percival, launched in May 2025 to find failures in agentic systems and suggest fixes. Evaluation Runs and the Experimentation SDK are Enterprise features. An older landing page names OpenAI, HP and Pearson as customers and offers on-premise deployment. The homepage, products page and pricing page no longer mention the platform. **AI compliance coverage** Patronus doesn't map its products to any AI regulation or standard and publishes no security certifications. Its older landing page says it is vetted by third-party security firms each year. **Who it's for** Frontier AI labs and large AI teams that buy training data and agent environments. Teams looking for an evaluation or observability tool to support compliance work should confirm that the evaluation platform is still sold and supported before buying.

Promptfoo is an open-source CLI and library for evaluating LLM prompts, models, RAGs, and agents through automated benchmarks and matrix comparisons, alongside red-teaming for security vulnerabilities like prompt injections, jailbreaks, PII leaks, and insecure tool use. It differentiates via developer-first local execution, CI/CD integration, and modular plugins covering 50+ attack types with community-driven threat intelligence. Targeted at developers and security teams in enterprises (127 Fortune 500 users), it supports self-hosting to avoid vendor lock-in. Enterprise adds collaboration, monitoring, SSO, and compliance dashboards. Acquired by OpenAI in March 2026 for integration into Frontier platform, remains open-source with SaaS/on-prem options.Promptfoo homepagePromptfoo docsPromptfoo pricing