Prompt Optimization Systems Prompt Engineering Tools

Tools for iteratively testing, evaluating, and automatically improving LLM prompts through structured experimentation, search algorithms, and performance metrics. Does NOT include prompt storage/repositories, workflow orchestration, or general prompt writing guides.

There are 53 prompt optimization systems tools tracked. 1 score above 70 (verified tier). The highest-rated is dottxt-ai/outlines at 80/100 with 13,552 stars. 1 of the top 10 are actively maintained.

Get all 53 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=prompt-engineering&subcategory=prompt-optimization-systems&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	dottxt-ai/outlines Structured Outputs	80	Verified	13,552	Python
2	takashiishida/arxiv-to-prompt Transform arXiv papers into a single LaTeX source that can be used as a...	65	Established	133	Python
3	microsoft/promptpex Test Generation for Prompts	54	Established	158	TeX
4	AI-secure/aug-pe [ICML 2024 Spotlight] Differentially Private Synthetic Data via Foundation...	43	Emerging	57	Python
5	Spr-Aachen/LLM-PromptMaster A simple LLM-Powered chatbot software.	43	Emerging	36	Python
6	equinor/promptly A prompt collection for testing and evaluation of LLMs.	36	Emerging	27	Jupyter Notebook
7	hunterooc/mudplayersolo LLMs playing MUDs, no world model, self-improving prompts	34	Emerging	4	Python
8	yizhangele/llm-guided-mod-optimization Implementation for “Hierarchical Optimization via LLM-Guided Objective...	32	Emerging	3	Python
9	colindoyle0000/llms-as-method-actors LLMs as Method Actors: A Model for Prompt Engineering and Architecture	31	Emerging	46	Python
10	hammer-mt/thumb A simple prompt testing library for LLMs.	31	Emerging	28	Python
11	microsoft/Evoke Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in...	30	Emerging	19	—
12	step2-technology/ga-llm GA + LLM hybrid framework for structured text generation and task optimization.	29	Experimental	5	Python
13	Spr-Aachen/LLM-PromptMaster-Backend Backend for LLM-PromptMaster	28	Experimental	3	Python
14	tddschn/langwhat pyWhat LLM version \| Answer "What is it?" on the command line with the power...	26	Experimental	7	Python
15	pyladiesams/optimize-ai-prompts-jun2025 Optimize AI prompts to reduce verbosity and carbon footprint with ScaleDown	25	Experimental	2	Jupyter Notebook
16	mistir-nigusse/LLM_Prompt_Engine AI-driven prompt generation and evaluation system, designed to optimize the...	25	Experimental	3	Python
17	rosaia/langworks Flexibly instruct and prompt LLMs in Python	24	Experimental	1	Python
18	BashMocha/Prompting-LLMs-for-Aerial-Navigation Prompts and source code for applying LLMs to UAV-based navigation tasks with...	24	Experimental	59	Python
19	pedrocvaranda/notebooklm-power-prompt High-performance prompt generator to maximize learning in NotebookLM	23	Experimental	1	HTML
20	parth-shinge/Hybrid-Prompt-Generator Hybrid prompt generation framework combining templates, LLMs, ensemble...	22	Experimental	—	Python
21	JRC1995/ZeroPromptSearch Implementation of an LLM prompting pipeline combined with wrappers for...	22	Experimental	15	Python
22	3aKHP/Neural-Narratology Research on LLM Interactive Narrative: From Reverse Engineering to Automated...	22	Experimental	—	PowerShell
23	gsavla6-hue/llm-prompt-optimizer Systematic LLM prompt optimization framework with A/B testing, metrics...	22	Experimental	—	Python
24	othercodes/prompt-lab Test prompt variants across LLM providers with LLM-as-judge evaluation	20	Experimental	1	Python
25	taylorsatula/TeaLeaves End-to-end pipeline for seeing how LLMs actually process your prompts....	20	Experimental	20	Python
26	canto-lang/canto-lang Language for programming LLMs	19	Experimental	7	Python
27	breezy89757/LlmPromptLab AI-powered Prompt Engineering Lab with Meta-Prompting and Auto-Evaluation...	19	Experimental	—	C#
28	ibrahimcesar/prompt-entropy-experiment Quantifying prompt quality using information theory: entropy and mutual...	18	Experimental	3	Jupyter Notebook
29	husain-zaidi/wordle-llm-solver Wordle solver agent using Semantic kernel to prompt Large language models.	16	Experimental	4	Python
30	KishoreMuruganantham/LipiForge A reproducible narrative transformation engine that uses RAG-style pipelines...	15	Experimental	—	Python
31	Dr-AneeshJoseph/Noumen-Loom-Game 🕸️ THE NOUMENAL LOOM: An Ontological Roguelike played inside LLMs....	15	Experimental	—	—
32	GuilhermeRuy97/prompt-evaluation-langsmith A project to take a suboptimal prompt from Langsmith, enhance it, submit it...	15	Experimental	6	Python
33	HebeHH/llm-prompt-experiments Experiment with multifactor analysis of different prompting strategies.	15	Experimental	6	TypeScript
34	kgkazakos/notebook_lm_prompt_generator A command-line Python tool that acts as an AI creative director for Google's...	14	Experimental	—	Python
35	tomazf8/invariant-well A framework for inducing structural invariants in LLMs via non-linear...	14	Experimental	—	HTML
36	keon/prompt-psychology Code used for The Prompt Psychology Myth article	14	Experimental	3	Python
37	marklysze/AutoGenPromptTesting Prompt testing Local LLMs for Microsoft's AutoGen	13	Experimental	10	Python
38	estebanpdl/narrative-blueprint AI-driven analysis workflow that uses LLMs to analyze narratives, content...	13	Experimental	2	Python
39	tkhang1999/repair-prompts Various prompt templates for automatic program repair using LLMs	12	Experimental	3	—
40	Pro-GenAI/Auto-Precise-Prompts Automated LLM-based Prompt Engineering for Structured Data Processing	12	Experimental	4	Jupyter Notebook
41	pwenker/prompt_teacher The Prompt Teacher is an interactive and educational prompt engineering...	12	Experimental	29	Python
42	zhoukuncheng/llm-vocabulary-reminder This project is a Telegram bot that sends daily reminders with English...	12	Experimental	3	Python
43	MercanCanpolat06/prompt-engineering-practice Trying various prompt engineering techniques and challenging them with both...	12	Experimental	1	Python
44	Yuyang-Yao75/Prompt-Enginneer-on-Recommend-System 传统的推荐系统依赖明确建模和大量特征工程，难以快速适配新的场景。本项目探索如何利用大语言模型（LLM）...	11	Experimental	—	Python
45	elanzini/steer Steer: Enhancing Control Flow and Steerability for Large Language Models	11	Experimental	2	Python
46	xyz9911/KPPO Official Implementation of "Beyond Elicitation: Provision-based Prompt...	11	Experimental	5	—
47	DevonFulcher/prompt-teacher An LLM prompt that helps to improve LLM prompts for AI applications by...	11	Experimental	—	Python
48	thatoldfarm/llminux An LLM playground for finding out what happens when LLM bugs are turned into...	11	Experimental	—	TypeScript
49	Saharsh1005/autonomous-prompting Developing an autonomous system for prompt selection for Large Language...	11	Experimental	—	Jupyter Notebook
50	stevenittileon/Wordle-Bot A Python-based Wordle-solving bot that uses frequency analysis and prompt...	11	Experimental	—	Jupyter Notebook
51	l0d0v1c/anteprompt Prepromt generator for LLM model, focused on personality	11	Experimental	—	HTML
52	Justmalhar/prompt-engineer-agent AI Prompt Engineer to automatically enhance and optimize prompts for large...	10	Experimental	1	Python
53	Anmolian/Prompt_Eval_LLM_Judge Prompt Design & LLM Judge	10	Experimental	1	Python

Comparisons in this category

promptpex and promptly (54 vs 36)