IBJunior/local-agent-docker-model-runner
A flexible, extensible AI agent backend built with NestJS—designed for running local, open-source LLMs (Llama, Gemma, Qwen, DeepSeek, etc.) via Docker Model Runner. Real-time streaming, Redis messaging, web search, and Postgres memory out of the box. No cloud APIs required!
This project provides a backend system for developers to quickly set up and run AI agents using local, open-source language models like Llama or Gemma, without needing cloud services. It takes your messages and model configurations to produce real-time AI responses, conversation history, and web search capabilities. It's designed for developers building custom AI applications, chatbots, or intelligent workflows where data privacy or cost control is important.
No commits in the last 6 months.
Use this if you are a developer building an AI application and want a flexible, self-hosted backend to run open-source Large Language Models (LLMs) locally with features like conversation memory and web search.
Not ideal if you are a non-developer looking for a ready-to-use AI tool or if you primarily rely on cloud-based LLM APIs (like OpenAI, Anthropic, or Google Cloud AI).
Stars
6
Forks
—
Language
TypeScript
License
—
Category
Last pushed
Jun 22, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/IBJunior/local-agent-docker-model-runner"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lobehub/lobehub
The ultimate space for work and life — to find, build, and collaborate with agent teammates that...
Pipelex/pipelex
Declarative language for composable Al workflows. Devtool for agents and mere humans.
strands-agents/sdk-typescript
A model-driven approach to building AI agents in just a few lines of code.
agents-flex/agents-flex
Agents-flex is A Lightweight Java AI Application Development Framework.
lemony-ai/cascadeflow
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside...