Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add cbt result analysis tool #135

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

neha-ojha
Copy link
Member

This PR adds a result analysis-tool to the CBT repository. It's job is to compare the test results against baseline parameter values. For now, we have restricted this tool to:

  • collect basic parameters like bandwidth, latency, iops etc. for radosbench and librbdfio
  • support a single value for each CBT config parameter rather than lists.

The primary purpose of this tool is to compare test results collected by running the CBT task on teuthology against baseline parameter values passed with the CBT task. It marks the job passed/failed based on the baseline and threshold provided.

One can also choose to run this tool with standalone CBT by adding a "baseline" section to the CBT yaml test configuration. This section should contain baseline numbers for the parameters being collected by the tool and a threshold value.

To use the tool, run the following command inside your CBT repository:
./analysis-tool.py <cbt_config.yaml> <cbt_results_dir>

For a librbdfio write test, the baseline section would look something like this:

baseline:
...
    threshold: 
    bw: 
    avg_iops: 
    std_dev_iops: 
    avg_lat: 
    std_dev_lat: 
...

Signed-off-by: Neha Ojha [email protected]

@neha-ojha
Copy link
Member Author

@jdurgin @markhpc: This is ready for review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants