Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DISP-S1 Support for Validator Tool #981

Draft
wants to merge 27 commits into
base: develop
Choose a base branch
from
Draft

DISP-S1 Support for Validator Tool #981

wants to merge 27 commits into from

Conversation

riverma
Copy link
Collaborator

@riverma riverma commented Sep 5, 2024

Purpose

  • Support for DISP-S1 validation from CMR
  • Refactoring DSWx-S1 codebase to be more generic and multi-product focused

Proposed Changes

  • [ADD] DISP-S1 support
    • Simulating complete frames checks for CSLC-S1 (see function map_cslc_bursts_to_frames)
    • Basic validation against delivered DISP-S1 granules, not yet tested to be working but work-in-progress (see function map_cslc_bursts_to_frames)
    • New CLI support for DISP-S1: see lines 792 through 810
  • [CHANGE] DSWx-S1 oriented CLI
  • [REMOVE] Old CLI python file that was specifically for dswx-s1 in place of a more general python script

Issues

Testing

  • Function map_cslc_bursts_to_frames tested locally
  • Example invocation for getting list of DISP frames that should be processed according to the logic of having complete CSLC burst coverage between a start and end time:
% python opera_validator.py --start "2024-07-18T21:49:22Z" --end "2024-07-18T23:51:00Z" --endpoint_daac_output UAT --timestamp TEMPORAL --validate --product DISP-S1 --disp_s1_burst_to_frame_db opera-s1-disp-burst-to-frame.json --disp_s1_frame_to_burst_db opera-disp-s1-consistent-burst-ids-with-datetimes.json
Total granules: 323
Querying CMR for time range 2024-07-18T21:49:22Z to 2024-07-18T23:51:00Z.

Fetching granules: 100%|████████████████████████████████████████████████████████████████████████| 323/323 [00:00<00:00, 351.39it/s]

Granule fetching complete.
  Frame ID    All Possible Bursts Count    Matching Bursts Count
     40032                           27                       27
     40033                           27                       27
     40034                           27                       27
     40039                           24                       24
     40025                           27                       27
     40026                           27                       27
     40029                           27                       27
     40030                           27                       27
     40031                           27                       27

riverma and others added 27 commits August 24, 2024 15:50
Pull issue-944 branch up to speed with develop branch
…rmining triggering logic for DISP-S1 processing for validation purposes
…ate DataFrame. Create DataFrame from CSLC analysis result
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants