promptfoo/promptfoo-action
The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
Automatically compares prompt changes between git commits and posts interactive before/after evaluations directly to pull requests, with support for push and manual workflow triggers. The action integrates with promptfoo's declarative YAML config system and web viewer for side-by-side result exploration, while supporting optional result caching and pass/fail thresholds to enforce quality gates in CI/CD pipelines.
Stars
47
Forks
23
Language
TypeScript
License
MIT
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/promptfoo/promptfoo-action"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI....
thunlp/OpenPrompt
An Open-Source Framework for Prompt-Learning.
bigscience-workshop/promptsource
Toolkit for creating, sharing and using natural language prompts.
dair-ai/Prompt-Engineering-Guide
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering,...
LearnPrompt/LearnPrompt
永久免费开源的 AIGC 课程, 目前已支持Prompt Engineering, ChatGPT, Midjourney, Runway, Stable Diffusion,...