Skip to content

Conversation

@idevasena
Copy link

@idevasena idevasena commented Dec 11, 2025

This commit is for VectorDB Benchmark implementation that allows you to benchmark and compare the performance of vector databases with current support for Milvus, DiskANN and HNSW indexing support and others planned.

The benchmark process consists of three main steps:

  • Loading vectors into the database
  • Monitoring and compacting the database
  • Running the benchmark queries

Detailed steps for setup and running benchmark are present in the README here: https://github.com/mlcommons/storage/pull/220/files#diff-c554ca2de4b3b7db86d7eb2b9c840e51edc6be7afe49bafe52dc95ce71969933

The PR also integrates unit test suite for the vdb_benchmakr vector database benchmarking tool.
It provides coverage for all components of vdb-bench, including:

  • Configuration management
  • Database connections
  • Vector generation and loading
  • Index management
  • Benchmarking operations
  • Compaction and monitoring
  • Performance metrics

Steps for running tests are present in the README here: https://github.com/mlcommons/storage/pull/220/files#diff-81f21bcb7d8cc604d135ef7b76a21e6aea402ee31251c6cccf5b3665bc8320de

@idevasena idevasena requested a review from a team December 11, 2025 02:45
@idevasena idevasena requested a review from a team as a code owner December 11, 2025 02:45
@github-actions
Copy link

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

Copy link
Contributor

@wvaske wvaske left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@idevasena idevasena merged commit 6876bac into mlcommons:TF_VDBBench Dec 12, 2025
1 check passed
@github-actions github-actions bot locked and limited conversation to collaborators Dec 12, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants