VectorDBBench and VBench

These are competitors—both benchmark vector database performance, but VectorDBBench targets specialized vector databases (like Milvus, Pinecone, Weaviate) while VBench evaluates vector analytics capabilities within traditional relational databases.

VectorDBBench
64
Established
VBench
24
Experimental
Maintenance 20/25
Adoption 10/25
Maturity 9/25
Community 25/25
Maintenance 0/25
Adoption 2/25
Maturity 9/25
Community 13/25
Stars: 1,038
Forks: 348
Downloads:
Commits (30d): 14
Language: Python
License: MIT
Stars: 2
Forks: 2
Downloads:
Commits (30d): 0
Language: Python
License: MIT
No Package No Dependents
Stale 6m No Package No Dependents

About VectorDBBench

zilliztech/VectorDBBench

Benchmark for vector databases.

Supports comprehensive performance and cost-effectiveness testing across 30+ vector databases and cloud services (Milvus, Pinecone, Weaviate, pgvector, Redis, etc.) using standardized real-world datasets (SIFT, GIST, Cohere embeddings). Implements realistic production workloads including concurrent insertion, serial/concurrent searching, and filtered search scenarios with configurable parameters like dimensionality, dataset size, and concurrency levels. Provides both CLI and web UI for test execution and generates comparative result reports with cost analysis for cloud deployments.

About VBench

microsoft/VBench

An Approximate Vector-Analytics Benchmark for Relational Databases

Scores updated daily from GitHub, PyPI, and npm data. How scores work