zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
599 stars and 1,862 monthly downloads. Used by 2 other packages. Actively maintained with 11 commits in the last 30 days. Available on PyPI.
Stars
599
Forks
29
Language
Python
License
MIT
Category
Last pushed
Mar 04, 2026
Monthly downloads
1,862
Commits (30d)
11
Dependencies
1
Reverse dependents
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/zhudotexe/kani"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.