machinelearningZH/semantic-search-eval
A framework for evaluating semantic search across custom datasets, metrics, and embedding backends.
Supports pluggable embedding backends (HuggingFace, OpenAI, BM25) with YAML-based configuration and automatic query generation via OpenAI or keyword extraction for datasets lacking ground-truth labels. Evaluates models against custom metrics (Accuracy@k, Latency) with built-in visualization and result caching to avoid re-running benchmarks; extensible through simple interface implementations for new models and metrics.
No commits in the last 6 months.
Stars
38
Forks
6
Language
Python
License
MIT
Category
Last pushed
May 26, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/machinelearningZH/semantic-search-eval"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
DmitryKey/bert-solr-search
Search with BERT vectors in Solr, Elasticsearch, OpenSearch and GSI APU
tkhang1999/semantic-food-search
A semantic food search web application built with Django, Solr, SBERT, and Docker
alihakimtaskiran/SemanticSearch
Meaningful Search
yberreby/ocaml-semsearch-jsoo
OCaml + js_of_ocaml + SBERT + TensorFlow.js
AxelPCG/SPLADE-PT-BR
SPLADE (Sparse Lexical AnD Expansion) model fine-tuned for Portuguese text retrieval. Based on...