drmingler/smart-llm-loader
smart-llm-loader is a lightweight yet powerful Python package that transforms any document into LLM-ready chunks. Spend less time on preprocessing headaches and more time building what matters. From RAG systems to chatbots to document Q&A, SmartLLMLoader handles the heavy lifting so you can focus on creating exceptional AI applications.
Leverages LiteLLM to support any multi-modal LLM provider (Gemini, GPT-4o, Claude) for intelligent document processing, with built-in OCR and markdown conversion via Poppler. Implements context-aware chunking strategies that preserve semantic structure and document layout (tables, headers), producing chunks tagged with semantic metadata rather than raw text splits. Integrates directly with LangChain and LlamaIndex for RAG pipelines and vector database ingestion.
Available on PyPI.
Stars
75
Forks
3
Language
Python
License
MIT
Category
Last pushed
Nov 14, 2025
Commits (30d)
0
Dependencies
10
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/drmingler/smart-llm-loader"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PaddlePaddle/PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR...
kreuzberg-dev/kreuzberg
A polyglot document intelligence framework with a Rust core. Extract text, metadata, and...
yfedoseev/pdf_oxide
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown...
opendataloader-project/opendataloader-pdf
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
NanoNets/docext
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking...