Cisco AI Defense vs Promptfoo

Cisco AI Defense is Cisco's security product for enterprise AI applications, models and agents. Cisco unveiled it on January 15, 2025 and said it would be available that March. It is built on Robust Intelligence, the AI security startup Cisco announced it would acquire on August 26, 2024 and finished acquiring on September 24, 2024; Dark Reading called Robust Intelligence the core component of AI Defense. The product is sold by Cisco Systems, Inc., which was incorporated in 1984 and is based in San Jose; this profile lists Cisco's founding year and headquarters, as the directory does for other big-company products. Cisco's May 2026 data sheet splits the product into four parts. AI Cloud Visibility discovers AI models, applications, connected data sources, MCP servers and agents, including assets in Amazon Bedrock, Google Vertex and Azure AI Foundry. AI Supply Chain Risk Management scans model files, repositories and MCP servers and tools, and gives each asset a risk score. AI Model and Application Validation runs algorithmic red teaming with more than 200 attack techniques and threat subcategories. AI Runtime Protection applies safety, security and privacy guardrails, enforces MCP policies at runtime and protects agent behavior. Runtime checks can run at the network level through Cisco Multicloud Defense, through a gateway, or through an Inspection API. Hybrid deployments (AWS EKS, Azure AKS, GCP and on-premises AI PODs on OpenShift) keep sensitive data in the customer's environment. A separate AI Access module, for employee use of third-party AI apps, comes through Cisco Secure Access and needs its Advantage package. **Agent and MCP security** In February 2026 Cisco added an AI bill of materials, an MCP Catalog, multi-turn red teaming of models and agents, real-time agentic guardrails and an integration with NVIDIA NeMo Guardrails; the release gave no availability dates. In March 2026 it launched AI Defense: Explorer Edition, a self-service red-teaming tool Cisco offers at no upfront cost, and announced an Agent Runtime SDK for Amazon Bedrock AgentCore, Google Vertex Agent Builder, Azure AI Foundry and LangChain, plus DefenseClaw, an open-source agent security framework. **Frameworks** Cisco says AI Defense has mapped to NIST, OWASP and MITRE frameworks since launch. Its data sheet names the NIST AI RMF, MITRE ATLAS and the OWASP Top 10 for LLMs, and red-team reports also map to Cisco's own Integrated AI Security and Safety Framework. We found no documented support for the EU AI Act or ISO 42001. **Who it's for** Large enterprises that already use Cisco security products (Secure Access, Multicloud Defense, Splunk) and want AI discovery, red teaming and runtime guardrails from one vendor. Cisco doesn't publish prices.

Promptfoo is an open-source CLI and library for evaluating LLM prompts, models, RAGs, and agents through automated benchmarks and matrix comparisons, alongside red-teaming for security vulnerabilities like prompt injections, jailbreaks, PII leaks, and insecure tool use. It differentiates via developer-first local execution, CI/CD integration, and modular plugins covering 50+ attack types with community-driven threat intelligence. Targeted at developers and security teams in enterprises (127 Fortune 500 users), it supports self-hosting to avoid vendor lock-in. Enterprise adds collaboration, monitoring, SSO, and compliance dashboards. Acquired by OpenAI in March 2026 for integration into Frontier platform, remains open-source with SaaS/on-prem options.Promptfoo homepagePromptfoo docsPromptfoo pricing