AnswerDotAI/byaldi
Use late-interaction multi-modal models such as ColPali in just a few lines of code.
Provides end-to-end multi-modal document retrieval using vision language models that encode both text and images, supporting PDF and image indexing with late-interaction ranking for semantic search. Built on ColPali/ColQwen2 architectures, it handles document-to-page-level retrieval with optional metadata tracking and base64 document storage. Integrates with RAGatouille's API patterns and leverages Flash Attention for GPU-accelerated encoding, with planned support for additional ColVLM models and HNSW indexing.
844 stars and 3,709 monthly downloads. No commits in the last 6 months. Available on PyPI.
Stars
844
Forks
94
Language
Python
License
Apache-2.0
Category
Last pushed
Jan 28, 2025
Monthly downloads
3,709
Commits (30d)
0
Dependencies
8
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/AnswerDotAI/byaldi"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
illuin-tech/colpali
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
jolibrain/colette
Multimodal RAG to search and interact locally with technical documents of any kind
nannib/nbmultirag
Un framework in Italiano ed Inglese, che permette di chattare con i propri documenti in RAG,...
OpenBMB/VisRAG
Parsing-free RAG supported by VLMs
chiang-yuan/llamp
[EMNLP '25] A web app and Python API for multi-modal RAG framework to ground LLMs on...