Promptfoo vs TrojAI

Promptfoo is an open-source CLI and library for evaluating LLM prompts, models, RAGs, and agents through automated benchmarks and matrix comparisons, alongside red-teaming for security vulnerabilities like prompt injections, jailbreaks, PII leaks, and insecure tool use. It differentiates via developer-first local execution, CI/CD integration, and modular plugins covering 50+ attack types with community-driven threat intelligence. Targeted at developers and security teams in enterprises (127 Fortune 500 users), it supports self-hosting to avoid vendor lock-in. Enterprise adds collaboration, monitoring, SSO, and compliance dashboards. Acquired by OpenAI in March 2026 for integration into Frontier platform, remains open-source with SaaS/on-prem options.Promptfoo homepagePromptfoo docsPromptfoo pricing

TrojAI is a Saint John, New Brunswick-based AI security company founded in 2019 by James Stewart and Stephen Goddard. The company provides an enterprise AI security platform with two core products: TrojAI Detect (pre-deployment model red teaming and vulnerability assessment) and TrojAI Defend (runtime AI firewall for AI applications and agents). In 2025, TrojAI extended Defend to cover MCP (Model Context Protocol) server governance, providing visibility and policy enforcement for agentic AI workflows. TrojAI serves primarily large enterprise customers in financial services and technology, helping them align with NIST, OWASP, MITRE ATLAS, and CSA frameworks. The company participated in Google's 2023 accelerator program for Canadian startups and was listed on the Vector Institute's '20 Canadian AI Startups to Watch.' TrojAI raised $5.75M in seed capital in April 2024 and maintains offices in Saint John, Fredericton, and Boston.