We built a real-world bench for vectorDBs (github.com) 1 point by redskyluan 14 hours ago 1 comment Copy Link View on Hacker News
Copy Link redskyluan 14 hours ago Collapse Comment - Most vector database benchmarks today focus on toy use cases: static data, pure ANN search, no filters, no writes.That’s not how things work in production.We built VectorDBBench to benchmark vector databases under real-world conditions. It’s open source and just hit v1.0.0.What’s new in v1.0.0:Label Filtering + vector search testsConcurrent read/write under pressureCustomer datasetBetter webUIIt supports several popular vector DBs out of the box (Milvus, Weaviate, Qdrant, Chroma, etc.) and is easy to extend.If you’re building anything with RAG, embeddings, or search infra, we’d love feedback. Reply View | 0 replies
Most vector database benchmarks today focus on toy use cases: static data, pure ANN search, no filters, no writes.
That’s not how things work in production.
We built VectorDBBench to benchmark vector databases under real-world conditions. It’s open source and just hit v1.0.0.
What’s new in v1.0.0:
Label Filtering + vector search tests
Concurrent read/write under pressure
Customer dataset
Better webUI
It supports several popular vector DBs out of the box (Milvus, Weaviate, Qdrant, Chroma, etc.) and is easy to extend.
If you’re building anything with RAG, embeddings, or search infra, we’d love feedback.