Open-source and enterprise platform for red-teaming, evaluating, and security-testing LLM apps, agents, and RAG pipelines.
What it does
Promptfoo is an AI security and evaluation platform, now part of OpenAI, used to test prompts, models, and RAG pipelines for vulnerabilities. It automates red-teaming to find prompt injections, jailbreaks, data leaks, and unsafe tool use in AI agents. The open-source Community edition runs locally or self-hosted, while Enterprise and On-Premise tiers add monitoring, compliance dashboards, and team controls.
Core features
Automated red-teaming attacks tailored to an app
Prompt and RAG pipeline evaluation harness
Real-time guardrails against jailbreaks
CI/CD and MCP/agent framework integrations
Code scanning for LLM vulnerabilities in IDEs
Remediation guidance surfaced in pull requests
Centralized security and compliance dashboards (Enterprise)
Best for
→Security teams stress-testing AI agents before launch
→Developers catching prompt-injection risks in CI/CD
→Enterprises monitoring LLM compliance across many apps
→Evaluating and comparing prompt/model performance
Pricing
Community
Free
Toolspool rankingby global site rank
Tutorials
Step-by-step: exactly how to get things done with it.