Skip to content

Commit

Permalink
Updates for "skip"
Browse files Browse the repository at this point in the history
- Adds skip outcome for test suite
- Adds skip to testing-events.md documentation
- Bump up message version numbers
  • Loading branch information
Daniel Han committed Jun 27, 2023
1 parent 0b15b5a commit f34e982
Show file tree
Hide file tree
Showing 3 changed files with 13 additions and 12 deletions.
8 changes: 4 additions & 4 deletions schemas/testcaserunfinished.json
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,9 @@
"type": {
"type": "string",
"enum": [
"dev.cdevents.testcaserun.finished.0.1.0"
"dev.cdevents.testcaserun.finished.0.2.0"
],
"default": "dev.cdevents.testcaserun.finished.0.1.0"
"default": "dev.cdevents.testcaserun.finished.0.2.0"
},
"timestamp": {
"type": "string",
Expand Down Expand Up @@ -64,7 +64,7 @@
"fail",
"cancel",
"error",
"skip"
"skip"
]
},
"severity": {
Expand Down Expand Up @@ -187,4 +187,4 @@
"context",
"subject"
]
}
}
9 changes: 5 additions & 4 deletions schemas/testsuiterunfinished.json
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,9 @@
"type": {
"type": "string",
"enum": [
"dev.cdevents.testsuiterun.finished.0.1.0"
"dev.cdevents.testsuiterun.finished.0.2.0"
],
"default": "dev.cdevents.testsuiterun.finished.0.1.0"
"default": "dev.cdevents.testsuiterun.finished.0.2.0"
},
"timestamp": {
"type": "string",
Expand Down Expand Up @@ -104,7 +104,8 @@
"pass",
"fail",
"cancel",
"error"
"error",
"skip"
]
},
"severity": {
Expand Down Expand Up @@ -157,4 +158,4 @@
"context",
"subject"
]
}
}
8 changes: 4 additions & 4 deletions testing-events.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,7 +102,7 @@ This event represents a started testCase execution.

This event represents a finished testCase execution. The event will contain the outcome and additional metadata as applicable.

- Event Type: __`dev.cdevents.testcaserun.finished.0.1.0`__
- Event Type: __`dev.cdevents.testcaserun.finished.0.2.0`__
- Predicate: finished
- Subject: [`testCaseRun`](#testcaserun)

Expand All @@ -113,7 +113,7 @@ This event represents a finished testCase execution. The event will contain the
| environment | `Object` [`environment`](continuous-deployment.md/#environment) | The environment in which this testCaseRun was running | `{"id": "1234"}`, `{"id": "dev", "source": "testkube-dev-123"}` ||
| testCase | `Object` [`testCase`](#testcase) | Definition of the testCase being executed | `{"id": "92834723894", "name": "Login Test", "type": "integration"}` | |
| testSuiteRun | `Object` [`testSuiteRun`](#testsuiterun) | A testSuiteRun to associate this testCaseRun with a containing testSuiteRun | `{"id":"Auth-TestSuite-execution-12334", "source": "staging/testkube"}` | |
| outcome | `String` | The outcome of the testSuite execution, one of `pass`, `fail`, `cancel`, `error` | `pass` ||
| outcome | `String` | The outcome of the testSuite execution, one of `pass`, `fail`, `cancel`, `error`, `skip` | `pass` ||
| severity | `String` | Severity if the test failed, one of `low`, `medium`, `high`, `critical` | `critical` |
| reason | `String` | A reason related to the outcome of the execution | `Cancelled by user`, `Failed assertion`, `Timed out` | |

Expand Down Expand Up @@ -154,7 +154,7 @@ This event represents a started testSuite execution.

This event represents a finished testSuite execution. The event will contain the outcome and additional metadata as applicable.

- Event Type: __`dev.cdevents.testsuiterun.finished.0.1.0`__
- Event Type: __`dev.cdevents.testsuiterun.finished.0.2.0`__
- Predicate: finished
- Subject: [`testSuiteRun`](#testsuiterun)

Expand All @@ -163,7 +163,7 @@ This event represents a finished testSuite execution. The event will contain the
| id | `String` | Uniquely identifies the subject within the source. | `unit`, `e2e`, `security` ||
| source | `URI-Reference` | [source](spec.md#source--context-) from the context | | |
| environment | `Object` [`environment`](continuous-deployment.md/#environment) | The environment in which this testSuiteRun was running | `{"id": "1234"}`, `{"id": "dev", "source": "testkube-dev-123"}` ||
| outcome | `String` | The outcome of the testSuite execution, one of `pass`, `fail`, `cancel`, `error` | `fail` ||
| outcome | `String` | The outcome of the testSuite execution, one of `pass`, `fail`, `cancel`, `error`, `skip` | `fail` ||
| severity | `String` | Severity if the test failed, one of `low`, `medium`, `high`, `critical` | `critical`, `low`, `medium`, `high` |
| reason | `String` | A reason related to the outcome of the execution | `Cancelled by user`, `Failed testCase` | |
| testSuite | `Object` [`testSuite`](#testsuite) | Definition of the testSuite being executed | `{"id": "92834723894", "name": "Auth TestSuite"}` | |
Expand Down

0 comments on commit f34e982

Please sign in to comment.