Browser Local LLM LLM Tools

Tools and frameworks for running large language models entirely in web browsers without cloud infrastructure, using technologies like WebGPU, WebAssembly, and transformers.js. Does NOT include cloud-based LLM APIs, desktop applications, or server-side inference engines.

There are 84 browser local llm tools tracked. 1 score above 70 (verified tier). The highest-rated is mlc-ai/web-llm at 86/100 with 17,562 stars and 188,037 monthly downloads. 2 of the top 10 are actively maintained.

Get all 84 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=browser-local-llm&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	mlc-ai/web-llm High-performance In-browser LLM Inference Engine	86	Verified	17,562	TypeScript
2	e2b-dev/desktop E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment...	61	Established	1,278	MDX
3	geekjr/quickai QuickAI is a Python library that makes it extremely easy to experiment with...	56	Established	162	Python
4	chrisrobison/textweb A text-grid web renderer for AI agents — see the web without screenshots	51	Established	76	JavaScript
5	Azure-Samples/llama-index-javascript This sample shows how to quickly get started with LlamaIndex.ai on Azure 🚀	49	Emerging	72	TypeScript
6	ParisNeo/lollms An all in one AI solution compatible with any known AI service on the planet	48	Emerging	53	Vue
7	AkagawaTsurunaki/zerolan-core ZerolanCore integrates many open-source, locally deployable AI models, and...	47	Emerging	86	Python
8	heripo-lab/llm-newsletter-kit-core An extensible framework to automate your entire newsletter workflow. Handles...	46	Emerging	41	TypeScript
9	xencon/aixcl Local first development platform with LLM integration.	44	Emerging	12	Shell
10	mindolph/Mindolph Mindolph is an open source personal knowledge management software with...	43	Emerging	191	Java
11	qusaismael/localllm Your LLM, Your Data , Your GUI.	43	Emerging	93	JavaScript
12	AmyangXYZ/PoPo Pose and animate MMD model with LLM and MPL code	42	Emerging	251	TypeScript
13	mrdjohnson/llm-x LLMX; Easiest 3rd party Local LLM UI for the web!	42	Emerging	292	TypeScript
14	rahuldshetty/llm.js Run Large-Language Models (LLMs) 🚀 directly in your browser!	41	Emerging	228	JavaScript
15	wsargent/groundedllm AI agent grounded with search and extract tools to reduce hallucination.	40	Emerging	78	Python
16	Dicklesworthstone/useful_coding_guides_for_llms Detailed Next.js best-practice guides designed for humans and LLM coding...	37	Emerging	19	—
17	callawaycloud/llm-apex-agents Run Large Language Model "Agents" in Salesforce apex	37	Emerging	55	Apex
18	qiuxchao/yapi-ai-mock 使用 LLM，将 YAPI 接口文档生成为本地的 Mock 文件。	35	Emerging	3	TypeScript
19	GeneploreAI/gibberifier Stun LLMs with random Unicode characters	34	Emerging	116	HTML
20	EmbraceAGI/LocalAGI LocalAGI：Locally run AGI powered by LLaMA, ChatGLM and more. ｜基于 ChatGLM,...	33	Emerging	82	Python
21	typesense/showcase-natural-language-search-cars-genkit Use LLMs with Typesense to power Natural Language Search	32	Emerging	14	TypeScript
22	danielroe/carpenter LLM-powered automations for triaging Nuxt issues	31	Emerging	76	TypeScript
23	r2d4/react-llm Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU....	31	Emerging	702	TypeScript
24	scottstirling/pi2llm LLM AI integration for PixInsight	31	Emerging	11	JavaScript
25	lbdudc/dsl-xpert This tool provides a web interface to define domain-specific languages and...	30	Emerging	16	JavaScript
26	nadchif/in-browser-llm-inference Download and run local LLMs within your browser	30	Emerging	24	JavaScript
27	thejoltjoker/lightroom-llama A lightroom plugin for interacting with ollama.	29	Experimental	9	Lua
28	hoangnv170752/StudyNest Local PC app for everyone to use LLM locally 🫡	28	Experimental	22	Rust
29	sedwards2009/llm-multitool Web UI for working with large language models	28	Experimental	38	Go
30	ugo-emekauwa/private-ai-setup-dream-guide The Private AI Setup Dream Guide for Demos automates the installation of the...	28	Experimental	7	Shell
31	medialab/ecologies-of-llm-practices Official website of EL2MP Medialab's project	28	Experimental	1	Svelte
32	tianrking/LEIA LEIA (LLM-driven Embedded Interface Architecture)	26	Experimental	3	JavaScript
33	akutishevsky/local-llm-playground LWC for running LLMs Locally in Salesforce Experience Cloud using picoLLM...	26	Experimental	4	JavaScript
34	Antonoko/playdate-puppy-llm A LLM interface that pays homage to rabbit r1 on Playdate.	26	Experimental	56	Lua
35	dvoaviarison/ring-doorbell-notifier Simple, AI powered, nodejs app that will let you skip the expensive...	25	Experimental	1	JavaScript
36	radames/LLM-automator Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace...	24	Experimental	154	Python
37	YoungLee-coder/Captra 基于LLM的验证码识别API服务	24	Experimental	5	TypeScript
38	yWorks/yfiles-graph-for-create-llama An interactive integration of yFiles for HTML with LlamaIndex to visualize...	24	Experimental	50	TypeScript
39	hilum-labs/local-llm-rn React Native SDK for local LLM inference and on-device AI on iOS and Android.	23	Experimental	1	TypeScript
40	GenR8ive/VizuLLM Schema-Driven Rendering Engine for LLM-Generated Documents	23	Experimental	6	TypeScript
41	Aditya060806/WebScope Stop sending screenshots to vision models. WebScope renders websites into...	23	Experimental	1	JavaScript
42	Singularities-AI/singularities-ai User-friendly LLM interface, self-hosted, offline, and privacy-first.	23	Experimental	6	Vue
43	akutishevsky/salesforce-local-llm-assistant LWC that runs LLMs locally on your computer and uses Salesforce records for context.	23	Experimental	13	Apex
44	final-kk/kandle A JavaScript Native PyTorch-aligned Machine Learning Framework, built from...	23	Experimental	6	TypeScript
45	StreamnDad/reeln-plugin-openai reeln-cli plugin for OpenAI-powered LLM integration — livestream metadata,...	22	Experimental	—	Python
46	SushieA1/LLM-js LM Studio & Ollama API Wrapper	22	Experimental	1	JavaScript
47	devtobi/aigelb Evaluation of LLMs and browser implementation for browsing the Web in Easy...	22	Experimental	—	Vue
48	KnightLordHUN/private-ai-setup-dream-guide 🤖 Automate local private AI setups for demos, showcasing models for diverse...	22	Experimental	—	Shell
49	sanand0/llmdemos A collection of LLM demos with business use-cases	22	Experimental	—	HTML
50	yashveerlabs/vite-plugin-llm Vite plugin that uses your local LLM to generate mock data and scaffold...	22	Experimental	—	TypeScript
51	AieatAssam/daily-unsupervised-llm-game A repository containing unsupervised automation to generate a daily web-based game.	22	Experimental	—	HTML
52	oidahdsah0/Rimworld_AI_Framework A revolutionary AI-powered framework for RimWorld that brings Large...	22	Experimental	12	C#
53	hannes-sistemica/browser-llm-webgpu Proof of concept for a reasoning model that runs locally in your browser...	22	Experimental	18	HTML
54	RandomGamingDev/local-on-device-llm-browser-extension-example An example & tutorial for learning how to get a local LLM running on the...	21	Experimental	2	JavaScript
55	matthieu-perso/native Open source & private LLM apps on your desktop	21	Experimental	10	TypeScript
56	jbilcke-hf/template-node-llama-express A minimalist Docker project to get started with Node, llama-node and...	21	Experimental	8	TypeScript
57	AnotiaWang/siliconcloud-stats 更详细的 SiliconCloud 统计分析	18	Experimental	14	Vue
58	whobot-ai/llms.txt WhoBot AI (呼波特) llms.txt — Machine-readable company profile for LLM...	16	Experimental	2	—
59	telunyang/nodejs_ai_basics 教材: 透過 Node.js 來體驗基礎的 AI 模型	16	Experimental	9	JavaScript
60	monatis/llm-api Web API and websocket for Large Language Models in C++	16	Experimental	4	C++
61	ngoodman3209/Llama3.1ExperimentOpenSource AI experiment using Meta Llama 3.1 with Ollama, LangChain.js, and Fastify in...	15	Experimental	—	TypeScript
62	ameshkov/llm-ads-demo Demo project that shows how LLM ads are implemented	15	Experimental	6	JavaScript
63	didinj/nodejs-llm-ai-app-example From Zero to AI App: Build and Deploy Your First LLM Project	15	Experimental	—	JavaScript
64	knoopx/llm-workbench Unleash the power of FOSS language models on your local machine	14	Experimental	32	TypeScript
65	bhataparnak/LLM-Fine-Tuning-Dashboard1 Forezy.ai LLM fine Tuning Dashboard is built using Next.Js, Tailwind CSS. It...	14	Experimental	3	JavaScript
66	Ivanyinamyah321/remove-local-temu 🦊 Hide local sellers on Temu to view only products directly shipped by Temu...	14	Experimental	—	JavaScript
67	walsh441/LMD 🧠 Generate dynamic narratives with LMD, a framework for episodic memory that...	14	Experimental	—	C#
68	knuthp/tools Misc simple HTML and python scripts. LLM generated	14	Experimental	—	HTML
69	linG5821/ollama-top-llm a model ranking about ollama	14	Experimental	—	TypeScript
70	ekelhala/llamactl-console A web UI for llamactl built with Go and React	14	Experimental	—	TypeScript
71	Asereardscon3/LLM-Fine-Tuning-Dashboard A comprehensive React/TypeScript dashboard for monitoring and managing...	14	Experimental	—	TypeScript
72	brainsaysno/metaprog An experimental and versatile library for exploring LLM-assisted meta-programming.	14	Experimental	13	TypeScript
73	Divyanshu-karma/ShikshaManthan ShikshaManthan	14	Experimental	—	HTML
74	monatis/open-tasks Let LLMs schedule tasks for you and itself	13	Experimental	11	Python
75	tomcasaburi/subplebbit-spam-test AI-powered captcha solving research project for Plebbit	13	Experimental	2	JavaScript
76	pccr10001/llm-captcha LLMs still need us to resolve CAPTCHAs.	12	Experimental	1	Go
77	farazzbhn/ManagedLanguageModel LLM .NET managed client for Large Language Model services ( OpenAI, Groq,...	11	Experimental	—	C#
78	SBanditaDas/ML-Large-Model-Suites-On-LLM-LCM-LAM A high-performance AI workstation showcasing LLM, LCM, and LAM paradigms....	11	Experimental	—	TypeScript
79	gizmo-ds/chatjs-mod Access large language models from KubeJS using an OpenAI-compatible API.	11	Experimental	—	Java
80	LLMist/Multi.LLM.ist MultiLLM Official Site	11	Experimental	—	JavaScript
81	venantvr-web/vuejs.lighthouse.llm Dashboard Lighthouse augmenté par LLM : scoring, graphiques Chart.js, export...	11	Experimental	—	JavaScript
82	old-zet/rgpd-friendly-llm Launch a small enough LLM locally, infer it via CPU with llama.cpp, and...	11	Experimental	—	JavaScript
83	whatrocks/oldpal Old Pal is an LLM-powered tool for exploring your local town's meeting minutes	10	Experimental	1	TypeScript
84	callbacked/psvita-llm A small storytelling LLM running on the PS Vita	10	Experimental	27	C

Comparisons in this category

web-llm and llm-x (86 vs 42) web-llm and llm.js (86 vs 41)