arena-ai/structured-logprobs
OpenAI's Structured Outputs with Logprobs
Provides token-level confidence scoring for OpenAI's Structured Outputs by mapping log probabilities to individual JSON fields, enabling reliability assessment of generated data. Offers two integration approaches: attaching logprobs as a separate response field or embedding them inline within the JSON output. Works directly with OpenAI's chat completions API using `logprobs=True` and custom JSON schemas.
203 stars and 1,276 monthly downloads. No commits in the last 6 months. Available on PyPI.
Stars
203
Forks
12
Language
Python
License
Apache-2.0
Category
Last pushed
May 26, 2025
Monthly downloads
1,276
Commits (30d)
0
Dependencies
3
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/arena-ai/structured-logprobs"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Ahoo-Wang/fetcher
Fetcher is not just another HTTP client—it's a complete ecosystem designed for modern web...
eric-tramel/slop-guard
Slop Scoring to Stop Slop
conorluddy/Persuader
Persuades your LLM to output schema conforming JSON. Prompts for N retries until schema is...
piyushgupta344/structured-llm
Provider-agnostic TypeScript library for Zod-validated, fully-typed structured output from any LLM
567-labs/instructor-js
structured extraction for llms