Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a result analysis-tool to the CBT repository. It's job is to compare the test results against baseline parameter values. For now, we have restricted this tool to:
The primary purpose of this tool is to compare test results collected by running the CBT task on teuthology against baseline parameter values passed with the CBT task. It marks the job passed/failed based on the baseline and threshold provided.
One can also choose to run this tool with standalone CBT by adding a "baseline" section to the CBT yaml test configuration. This section should contain baseline numbers for the parameters being collected by the tool and a threshold value.
To use the tool, run the following command inside your CBT repository:
./analysis-tool.py <cbt_config.yaml> <cbt_results_dir>
For a librbdfio write test, the baseline section would look something like this:
Signed-off-by: Neha Ojha [email protected]