Node LLM Client SDKs LLM Tools

Official and community Node.js/TypeScript SDK wrappers for various LLM providers and APIs, enabling unified or provider-specific programmatic access to language models. Does NOT include frameworks for building LLM applications, testing tools, monitoring platforms, or higher-level abstractions like agents or RAG systems.

There are 127 node llm client sdks tools tracked. 7 score above 50 (established tier). The highest-rated is lmstudio-ai/lms at 65/100 with 4,341 stars. 2 of the top 10 are actively maintained.

Get all 127 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=node-llm-client-sdks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	lmstudio-ai/lms LM Studio CLI	65	Established	4,341	TypeScript
2	lmstudio-ai/lmstudio-js LM Studio TypeScript SDK	62	Established	1,536	TypeScript
3	nbonamy/multi-llm-ts A Typescript library to use LLM providers APIs in a unified way.	58	Established	79	TypeScript
4	token-js/token.js Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.	58	Established	304	TypeScript
5	samestrin/llm-interface A simple NPM interface for seamlessly interacting with 36 Large Language...	55	Established	120	JavaScript
6	foundation-interface/graphologue Use LLM to stream diagrams, instead of tokens, in real-time! (UIST 2023 Paper)	51	Established	347	TypeScript
7	gregreindel/llm-exe A package that provides simplified base components to make building and...	51	Established	130	TypeScript
8	justyns/silverbullet-ai Plug for SilverBullet to integrate LLM functionality	47	Emerging	78	TypeScript
9	CloudSilk/CloudSilk 云梭生产运营管理系统，作为工厂的“智能中枢”，负责精确调度与优化整个生产流程的各个环节。想象一下，一个工厂里有各种各样的机器和工人，他们需要按照一定的顺序...	45	Emerging	20	Go
10	Flame-Code-VLM/Flame-Code-VLM Flame is an open-source multimodal AI system designed to translate UI design...	45	Emerging	556	Python
11	zbigniewsobiecki/llmist Streaming-first multi-provider LLM client in TypeScript with home-made tool calling	44	Emerging	5	TypeScript
12	xushengfeng/lime 大模型驱动的拼音输入法	44	Emerging	539	TypeScript
13	wearedevx/llm-together Plugin for LLM-CLI adding support for Together.AI hosting a large collection...	43	Emerging	18	Python
14	foyer-work/merlin-node Merlin SDK Provides A Unified API To Interact With 20+ LLM Models.	43	Emerging	42	TypeScript
15	McGill-NLP/weblinx WebLINX is a benchmark for building web navigation agents with...	42	Emerging	160	Python
16	vertz-dev/vertz The TypeScript stack for LLMs	42	Emerging	19	TypeScript
17	Beledarian/Beledarians_LM_Studio_Toolbox This project is a plugin for LM Studio that provides a rich set of tools to...	41	Emerging	14	TypeScript
18	themaximalist/llm.js Universal LLM Interface	41	Emerging	134	HTML
19	node-llm/node-llm The Backend-First AI SDK for Node.js. NodeLLM is an open-source...	39	Emerging	25	TypeScript
20	piyook/llm-mock A local mock LLM server for early front end development work	39	Emerging	7	TypeScript
21	langtail/langtail-node Langtail TypeScript SDK	39	Emerging	12	TypeScript
22	deepinfra/deepinfra-node Official TypeScript wrapper for DeepInfra Inference API	39	Emerging	20	TypeScript
23	mokksy/ai-mocks AI-Mocks is a Kotlin-based mock server toolkit that brings service...	39	Emerging	39	Kotlin
24	meistrari/cursive ✦ The intuitive LLM framework	38	Emerging	113	TypeScript
25	hilum-labs/local-llm Open source Node.js runtime for local LLM inference, on-device AI, and...	38	Emerging	1	TypeScript
26	IdeaLeap/llm-ops 助力AIGC落地应用、高效开发llm workflow的低代码TS框架	38	Emerging	21	TypeScript
27	axiomhq/modeldb Free LLM API	38	Emerging	12	TypeScript
28	zya/litellmjs JavaScript implementation of LiteLLM.	37	Emerging	146	TypeScript
29	hansjm10/vitest-llm-reporter The goal of this reporter is to provide rich context from test errors that...	37	Emerging	11	TypeScript
30	pmndrs/prai JS Framework for building step-by-step LLM instructions	37	Emerging	76	TypeScript
31	vertesia/llumiverse Universal connector to LLMs for Node.js & Bun	37	Emerging	30	TypeScript
32	rosssaunders/coincise Store for LLM friendly versions of Crypto Exchange APIs	36	Emerging	6	JavaScript
33	woniu9524/CodeAsk This is an LLM-based code reader.	36	Emerging	920	TypeScript
34	skovy/llm-markdown Demo rendering rich responses from LLMs	36	Emerging	163	TypeScript
35	vlm-run/vlmrun-node-sdk Official Node.js SDK for VLM Run	36	Emerging	11	TypeScript
36	Siddhesh2377/Ai-Systems-New On-device AI SDK powering ToolNeuron — LLM chat & tool calling (llama.cpp),...	35	Emerging	7	C++
37	jrhizor/elelem Simple, opinionated, JSON-typed, and traced LLM framework for TypeScript.	35	Emerging	37	TypeScript
38	pezzolabs/UniLLM 🦄 Consume any LLM from any provider, using the OpenAI API	35	Emerging	28	TypeScript
39	llmops-build/llmops A pluggable LLMOps toolkit for TypeScript applications.	33	Emerging	44	TypeScript
40	humania-org/humanize LLM IS AS GOOD AS YOU ARE	33	Emerging	192	Shell
41	lockllm/lockllm-npm Official JavaScript/TypeScript SDK for LockLLM	33	Emerging	1	JavaScript
42	0x6a69616e/node-vercel-llm-api JavaScript implementation of ading2210/vercel-llm-api.	31	Emerging	7	JavaScript
43	Mozilla-Ocho/formulaic-node The official Node library for Formulaic	31	Emerging	8	JavaScript
44	githubnext/llmorpheus LLM-based mutation testing	30	Emerging	14	TypeScript
45	laiso/askrepo Source code reading with LLM.	30	Emerging	223	TypeScript
46	sanand0/policyascode Generate dynamic learning memory from LLMs	30	Emerging	2	JavaScript
47	lunary-ai/abso TypeScript SDK to call 100+ LLM Providers in OpenAI format.	30	Emerging	55	TypeScript
48	l1m-io/l1m The easiest way to get structured data from unstructured text or images...	29	Experimental	55	TypeScript
49	lamroger/waffie LLM API automated testing tool	29	Experimental	10	TypeScript
50	pablof7z/tenex-tools TENEX-tools	29	Experimental	5	TypeScript
51	tensorchord/modelz-docs Modelz is a developer-first platform for prototyping and deploying machine...	28	Experimental	7	MDX
52	ant4g0nist/polar A LLDB plugin which brings LLMs to LLDB	28	Experimental	131	Python
53	r2d4/llm.ts Call any LLM with a single API. Zero dependencies.	28	Experimental	215	TypeScript
54	iovdin/tune-models LLM models for tune, from openai, anthropic, openrouter, groq, ollama, mistral	27	Experimental	2	JavaScript
55	phospho-app/phosphojs The Node package for phospho, the LLM analytics platform	26	Experimental	5	TypeScript
56	mandoline-ai/mandoline-node Official Node.js client for the Mandoline API	25	Experimental	2	TypeScript
57	DataSQRL/acorn.js Turn GraphQL APIs into LLM Tools	25	Experimental	21	TypeScript
58	monum/llm-prototypes Experimental projects with LLMs such as langchain agent chatbot; Google...	25	Experimental	5	JavaScript
59	mybigday/node-qnn-llm Qualcomm lib Genie binding for Node.js	24	Experimental	1	C++
60	lalanikarim/tool-calling-llm-js A JS module to help convert any LangChain Chat Model into a Tool Calling LLM	24	Experimental	4	TypeScript
61	kid1412621/beavarr LLM armed *arr stack watch experience	22	Experimental	—	TypeScript
62	sensoris/semcache-node Node SDK for the Semcache API	22	Experimental	1	JavaScript
63	snowheapllc/StruktX A configurable, typed AI framework with swappable LLM, classifier, handlers,...	22	Experimental	3	Python
64	charbelrami/tiny-llm-pipeline YAML DSL for LLM pipeline creation. Tiny. ESM. No deps.	22	Experimental	1	JavaScript
65	shba007/unai Unified AI Library. For Ollama, Gemini, OpenAI, Perplexity	22	Experimental	—	TypeScript
66	Aswinsaipalakonda/llm-mock Drop-in mock clients for OpenAI and Anthropic SDKs. Test LLM-powered apps...	22	Experimental	—	TypeScript
67	trchopan/proma Project Management Toolkit powered by LLMs	22	Experimental	—	TypeScript
68	theblixguy/llm-mock-server A standalone mock LLM server for deterministic testing: OpenAI, Anthropic,...	22	Experimental	—	TypeScript
69	miles990/myelin Stop paying your LLM to make the same decision twice. Crystallize repeated...	22	Experimental	—	TypeScript
70	jeffdafoe/llm-memory-api LLM support for long-term memory, semantic search, and real-time communication.	22	Experimental	—	JavaScript
71	michael-tiller/LlamaBrain Open-source LLM governance framework for .NET. Deterministic validation,...	22	Experimental	—	C#
72	KillTrot/WindsurfPortable Make Windsurf Portable to have multiple, completely independent profiles on...	22	Experimental	—	C#
73	Emi0084/dust-llm-capacitor Enable seamless integration of Dust LLM capabilities into Capacitor apps for...	22	Experimental	—	HTML
74	azur-lane-ecgc/local-llm-parsing Repository for LLM data parsing using OpenCode	22	Experimental	—	TypeScript
75	JSLEEKR/mocklm LLM response mocking for tests — streaming SSE, tool_use blocks, fuzzy...	22	Experimental	—	TypeScript
76	yashveerlabs/tool-registry Define LLM tools once, use them with OpenAI, Anthropic, and Gemini. Handles...	22	Experimental	—	TypeScript
77	howlabs/openstream Minimal AI streaming library for TypeScript. OpenAI-first today, designed to...	22	Experimental	—	TypeScript
78	assistant-ui/modelpedia Open catalog of AI models across providers	22	Experimental	—	TypeScript
79	yashveerlabs/llm-stream Unified streaming interface for OpenAI, Anthropic, Ollama, and any...	22	Experimental	—	TypeScript
80	polyphon-ai/polyphon-js JavaScript/TypeScript SDK for the Polyphon JSON-RPC API	22	Experimental	—	TypeScript
81	pAIrprogio/synscript Libraries for immutable and chainable LLM compatible scripting	21	Experimental	6	TypeScript
82	lucasavila00/LmScript Controllable Language Model Interactions in TypeScript	21	Experimental	10	TypeScript
83	rodacato/SheLLM Your LLM subscriptions as a REST API	21	Experimental	2	JavaScript
84	quolo-ai/quolo Quolo enables companies to easily build their own platforms that leverage...	20	Experimental	46	TypeScript
85	open-and-sustainable/alembica Open science package for LLM-powered semantic synthesis and precise...	20	Experimental	1	Go
86	mazenemam19/work-impact-analysis-demo Automated impact analysis using LLM to help you understand and articulate your work.	20	Experimental	1	JavaScript
87	frost-beta/llm.js Node.js module providing inference APIs for large language models, with simple CLI.	19	Experimental	23	TypeScript
88	hexxt-git/llm-steganography hide secrets in normal looking text using an LLM	18	Experimental	8	TypeScript
89	nakasyou/lmspecs Open-Source Language Model Database for comparison	18	Experimental	26	TypeScript
90	Yawanseh/guidescript GuideScript: Navigating Language Models, Simplified.	17	Experimental	56	TypeScript
91	ProCoder1199X/EasiScriptX A high-performance domain-specific language (DSL) for AI/ML workflows.	17	Experimental	2	C++
92	San279/object-detect-FOMO-stream-Esp32 This is intended for streaming FOMO(object detection model) trained using...	17	Experimental	2	JavaScript
93	detunjiSamuel/pocket-engineer USE LLM TO GENERATE APPLICATIONS	16	Experimental	3	JavaScript
94	greenido/multi-LLM-at-once Query few LLMs with one query and see who is the best 🙌🏾	16	Experimental	3	EJS
95	wuvictor-95/ocr-llm An LLM-assisted multi-form API endpoint to convert image text into JSON	16	Experimental	3	Go
96	ali-m07/teams-llm-bot Enterprise-grade LLM integration for Microsoft Teams with Power Automate -...	15	Experimental	—	JavaScript
97	GeekBoySupreme/brunch Brunch is an alternative interface prototype to interact with Large Language Models	15	Experimental	7	JavaScript
98	eunomia-bpf/.github eunomia-bpf project template	15	Experimental	—	—
99	multimindlab/multimind-sdk-js JavaScript for MultiMindSDK – bring advanced context transfer and multi-LLM...	15	Experimental	8	TypeScript
100	0xcadams/hopfield 🐇 Typescript-first LLM framework with static type inference, testability,...	15	Experimental	19	TypeScript
101	gl0bal01/llm-1minai LLM plugin providing access to AI models through 1min.ai API with web...	15	Experimental	—	Python
102	log10-io/log10js JavaScript client library for managing your LLM data in one place	14	Experimental	11	JavaScript
103	stefanwille/llm-tokens-playground A demo that makes LLM tokenization more tangible.	14	Experimental	—	TypeScript
104	NickCorneau/Petrr-LLM LLM-based Personal Training Research aide	14	Experimental	1	TypeScript
105	ncmprbll/lookupper-self-hosted Self-hosted Lookupper	14	Experimental	—	Go
106	butterflyio/promptraise We help projects rank on top LLMs	14	Experimental	—	TypeScript
107	pali-mem/pali-js Typed JavaScript/TypeScript client and middleware for the Pali memory API.	14	Experimental	—	TypeScript
108	yockii/llm-mock-hub llm api mock hub	14	Experimental	—	TypeScript
109	hoipippeloi/llmngn.xyz $ llmngn_ is a context persistence plugin for OpenCode that remembers your...	14	Experimental	—	TypeScript
110	andygeek/multillama-ts MultiLlama 🦙🦙🦙 is a TypeScript framework for using multiple LLMs...	14	Experimental	4	TypeScript
111	feedox/husher 🤫 husher - Encode text to be hidden from human eyes but visible to LLMs	14	Experimental	12	TypeScript
112	pyronaur/zod-mind Type-safe interaction with LLMs like GPT	14	Experimental	1	TypeScript
113	markomanninen/llm-experiments Large Language Models (OpenAI, Anthropic, Groq, Ollama) tested in NodeJS CLI...	13	Experimental	2	JavaScript
114	space0blaster/dora-cli A CLI version for the deep search tool.	13	Experimental	7	JavaScript
115	holasoymalva/typescript_mlm A specialized Micro Language Model engineered for TypeScript development	13	Experimental	2	—
116	danieltyx/ModelMint We streamline the process of training customized AI models, distribution of...	13	Experimental	6	TypeScript
117	attilacsanyi/llm-playground Playing with different LLM capabilities in Nx workspace	12	Experimental	1	TypeScript
118	lirantal/devrel-llm-tools This repository contains the code for experiments that demonstrate...	12	Experimental	4	JavaScript
119	twaslowski/grammr Reference toolkit for language-learning, aimed at systematic learners	11	Experimental	2	TypeScript
120	mysticfall/eldermind A framework designed for building LLM-driven mods for The Elder Scrolls: Skyrim.	11	Experimental	—	TypeScript
121	sanand0/assessor Assess documents for clauses using LLMs	11	Experimental	—	JavaScript
122	Vivekveer31/llm-cli-with-websearch Agentic LLM CLI built with Node.js featuring session memory and real-time...	11	Experimental	—	JavaScript
123	danpozmanter/mock-api Mock an arbitrary API using an OpenAPI spec	11	Experimental	—	Go
124	NexTech-Fusion/Rawen-toolbelt A playground of many approaches around AI espacially LLM by using different...	11	Experimental	—	TypeScript
125	nyatinte/typesafe-llm Tips for Using LLMs in a Type-safe	10	Experimental	1	TypeScript
126	Namchee/dupliket Triage issues and discussions efficiently by resolving duplicate references...	10	Experimental	1	TypeScript
127	buildownai/tools Monorepository of LLM based t AI ools provided by BuildOwn.AI	10	Experimental	1	TypeScript

Comparisons in this category

lms and lmstudio-js (65 vs 62) multi-llm-ts and token.js (58 vs 58) llm-interface and llm.js (55 vs 41) llm-interface and node-llm (55 vs 39) multi-llm-ts and llmist (58 vs 44)