Dicklesworthstone/frankensearch
Two-tier hybrid search for Rust: sub-millisecond initial results via potion-128M, quality-refined rankings in 150ms via MiniLM-L6-v2. Combines lexical (Tantivy BM25) and semantic (vector cosine) search with Reciprocal Rank Fusion. Progressive iterator API, f16 SIMD vector index, feature-gated compilation.
# Technical Summary Provides both a library and standalone CLI (`fsfs`) for local-only hybrid search, with a modular crate architecture separating embedding, lexical indexing (Tantivy), vector storage (FSVI with quantized f16), and fusion orchestration—enabling independent evolution of each layer. Queries flow through canonicalization and type classification, then execute a two-phase pipeline: fast BM25 + potion-128M embedding fused via Reciprocal Rank Fusion for immediate results, followed by optional quality reranking with MiniLM and cross-encoder integration. Environment variables, config files, and CLI flags control phase behavior (fast-only mode, RRF constants, scoring weights), with streaming output modes (JSON Lines, TOON) designed for agent integration and watch-mode incremental indexing for corpus updates.
Stars
41
Forks
9
Language
Rust
License
—
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/Dicklesworthstone/frankensearch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
winkjs/wink-bm25-text-search
Fast Full Text Search based on BM25
run-llama/semtools
Semantic search and document parsing tools for the command line
Hamza5/file-brain
Smart local file search app that understands your files
Fl0k3n/kfe
Cross-platform Search Engine and File Explorer for Multimedia
OpenConceptLab/oclmap
OCL Mapper (beta): an open-source AI-supported terminology mapping solution for the global community