Add FIO tests to check the data integrity #1893
Merged
+322
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
syeleti-msft
requested review from
ashruti-msft,
jainakanksha-msft,
souravgupta-msft and
vibhansa-msft
as code owners
There was a problem hiding this comment.
Pull Request Overview
This PR adds FIO (Flexible I/O tester) workloads to test data integrity for file cache and block cache in Blobfuse2. The tests are configured as an optional stage that doesn't run by default.
- Introduces comprehensive FIO test configurations for various I/O patterns including sequential, random, and hole-based workloads
- Adds a new pipeline stage for running FIO tests with both file cache and block cache configurations
- Increases file cache size limit from 2GB to ~20GB to accommodate larger test workloads
Reviewed Changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated 4 comments.
| File | Description |
|---|---|
| testdata/config/azure_key.yaml | Increases max-size-mb for file cache from 2048 to 20480 |
| test/fio/*.fio | Adds FIO job configuration files for different test scenarios |
| blobfuse2-nightly.yaml | Adds optional FIO test stage to nightly pipeline |
| azure-pipeline-templates/fio-data-integrity.yml | Implements FIO test execution template |
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
vibhansa-msft
approved these changes
Jul 31, 2025
vibhansa-msft
approved these changes
Sep 29, 2025
ashruti-msft
approved these changes
Sep 29, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Type of Change
Description
** Add fio workloads to check the data integrity of the file cache and block cache.
** Making the stage not run by default due to the known issues.