hegelai/prompttools
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
Enables systematic A/B testing of prompts and parameters across multiple LLM providers in notebooks and code through an `Experiment` API that collects and visualizes results. Includes a local Streamlit playground for interactive experimentation and supports evaluating vector database retrieval accuracy alongside LLM performance. Integrates with LangChain, MindsDB, and computer vision models like Stable Diffusion, with all execution and data remaining on your local machine.
3,026 stars and 258 monthly downloads. Available on PyPI.
Stars
3,026
Forks
254
Language
Python
License
Apache-2.0
Category
Last pushed
Feb 11, 2026
Monthly downloads
258
Commits (30d)
0
Dependencies
9
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/hegelai/prompttools"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.