zilliztech/VectorDBBench

Supports comprehensive performance and cost-effectiveness testing across 30+ vector databases and cloud services (Milvus, Pinecone, Weaviate, pgvector, Redis, etc.) using standardized real-world datasets (SIFT, GIST, Cohere embeddings). Implements realistic production workloads including concurrent insertion, serial/concurrent searching, and filtered search scenarios with configurable parameters like dimensionality, dataset size, and concurrency levels. Provides both CLI and web UI for test execution and generates comparative result reports with cost analysis for cloud deployments.

1,038 stars. Actively maintained with 14 commits in the last 30 days.