myscale/vector-db-benchmark
Framework for benchmarking fully-managed vector databases
This framework helps developers, architects, and product managers evaluate and compare the performance and cost-effectiveness of different fully-managed vector databases. It takes typical workloads and dataset configurations as input, then outputs metrics like queries per second (QPS) and cost-performance ratios. This allows technical decision-makers to select the best vector database for their specific application needs.
No commits in the last 6 months.
Use this if you need to choose a managed vector database for your AI application and want to objectively compare options based on throughput and cost.
Not ideal if you are looking to benchmark self-hosted or on-premise vector database solutions, as this is tailored for fully-managed cloud services.
Stars
80
Forks
19
Language
Python
License
Apache-2.0
Category
Last pushed
Sep 24, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/vector-db/myscale/vector-db-benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lancedb/lancedb
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
zilliztech/VectorDBBench
Benchmark for vector databases.
qdrant/vector-db-benchmark
Framework for benchmarking vector search engines
prrao87/lancedb-study
Comparing LanceDB and Elasticsearch for full-text search and vector search performance
vector-index-bench/vibe
Vector Index Benchmark for Embeddings (VIBE) is an extensible benchmark for approximate nearest...