PacificAI/langtest
Deliver safe & effective language models
Provides automated testing across 60+ test types covering robustness, bias, fairness, and accuracy—with data augmentation capabilities to iteratively improve models. Integrates with Spark NLP, Hugging Face, and major LLM APIs (OpenAI, Cohere, Azure-OpenAI) for NER, translation, text classification, and question-answering tasks. Uses a fluent harness API to generate, execute, and report on adversarial and stress tests in a single pipeline.
552 stars.
Stars
552
Forks
50
Language
Python
License
Apache-2.0
Category
Last pushed
Feb 19, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/PacificAI/langtest"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
microsoft/OpenRCA
[ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?
Babelscape/ALERT
Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language...
TrustGen/TrustEval-toolkit
[ICLR'26, NAACL'25 Demo] Toolkit & Benchmark for evaluating the trustworthiness of generative...
ChenWu98/agent-attack
[ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
ast-fortiss-tum/STELLAR
STELLAR: A Search-Based Testing Framework for Large Language Model Applications" (SANER 2026) 🏆