YDA-5829 troubleshooting tool for published data packages

[FuHsinyu]

New Shell Script

• Added troubleshoot_published_data.sh: This script troubleshoots packages based on user input. It provides options to either troubleshoot a single package or all published packages.

New Python Rule

• Task 1: Retrieve all published data packages from the vault.
• Task 2: Conduct four types of verification for each published data package:
  • Metadata Schema Check: Ensures all data packages comply with the predefined metadata schema.
  • AVU Check: Checks for the presence and correctness of expected AVU pairs.
  • Data Cite Registration: Verifies registration with Data Cite through versionDOI and baseDOI.
  • File Integrity Checks: Checks the MD5 of landing page and combi JSON files against those on the public server.

Pending Task

• Output to Terminal: Implementing a feature to output results directly to the terminal (stdout) is pending and would enhance usability. Completed!

Continuation

• Sirjan and Claire may pick it up from here for changes due to my holiday leaves

[claravox]

Would it be okay for vault-metadata-schema-report.r to print to standard out (or standard error) any errors instead of rodsLog?

[lwesterhof]

LGTM!