utkusen/promptmap
a security scanner for custom LLM applications
Employs a dual-LLM architecture where a controller model evaluates whether attack payloads successfully compromise the target application, enabling both white-box testing (direct model access with system prompts) and black-box testing (HTTP endpoints). Includes 50+ pre-built YAML-configurable rules across prompt stealing, jailbreaking, and bias categories, with support for OpenAI, Anthropic, Google, XAI, and local Ollama models.
1,146 stars.
Stars
1,146
Forks
120
Language
Python
License
GPL-3.0
Category
Last pushed
Dec 01, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/utkusen/promptmap"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
protectai/llm-guard
The Security Toolkit for LLM Interactions
MaxMLang/pytector
Easy to use LLM Prompt Injection Detection / Detector Python Package with support for local...
agencyenterprise/PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a...
Dicklesworthstone/acip
The Advanced Cognitive Inoculation Prompt
Resk-Security/Resk-LLM
Resk is a robust Python library designed to enhance security and manage context when...