miko-ai-org/llmbatching
An openAI / LLM API wrapper that simplifies the batching API to reduce costs by 50%
25
/ 100
Experimental
No commits in the last 6 months.
Stale 6m
No Package
No Dependents
Maintenance
2 / 25
Adoption
6 / 25
Maturity
9 / 25
Community
8 / 25
Stars
19
Forks
2
Language
TypeScript
License
MIT
Category
Last pushed
May 26, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/miko-ai-org/llmbatching"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/multilspy
multilspy is a lsp client library in Python intended to be used to build applications around...
78
mlc-ai/xgrammar
Fast, Flexible and Portable Structured Generation
68
vicentereig/dspy.rb
The Ruby framework for programming—rather than prompting—language models.
51
hyparam/hyllama
llama.cpp gguf file parser for javascript
48
llmrb/llm.rb
Ruby toolkit for multiple Large Language Models (LLMs)
45