You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is a follow-up to the discussion in csaf-sbom/kotlin-csaf#80 (comment). We make use of the TC test cases JSONs in testing the validation tests in kotlin-csaf. While exploring options to keep tests in sync with the TC, we came up with the idea whether it is possible to include an expected failure "message" in the testcases.json. This way we could align the error messages in our library with the official ones and we could query the testcases.json to automatically assert good and bad test cases even with the appropriate error.
Further discussion points
Does it make sense to introduce some kind of official error codes for the validation?
Should it be mandatory for CSAF libraries to use these error codes or messages
This would make developing compliant CSAF libraries much more easier, sort of like a Technology Compatibility Kit.
The text was updated successfully, but these errors were encountered:
oxisto
changed the title
Provide a failure "state" or "message" in testcases.json
Provide an expected failure "code" or "message" in testcases.json
Oct 31, 2024
This is a follow-up to the discussion in csaf-sbom/kotlin-csaf#80 (comment). We make use of the TC test cases JSONs in testing the validation tests in kotlin-csaf. While exploring options to keep tests in sync with the TC, we came up with the idea whether it is possible to include an expected failure "message" in the testcases.json. This way we could align the error messages in our library with the official ones and we could query the testcases.json to automatically assert good and bad test cases even with the appropriate error.
Further discussion points
This would make developing compliant CSAF libraries much more easier, sort of like a Technology Compatibility Kit.
The text was updated successfully, but these errors were encountered: