Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report missing thumbnails #431

Open
edsu opened this issue May 17, 2022 · 2 comments
Open

Report missing thumbnails #431

edsu opened this issue May 17, 2022 · 2 comments
Labels
enhancement hold for PO review PO needs to sign off before merge web archiving for June-July 2022 work cycle

Comments

@edsu
Copy link
Contributor

edsu commented May 17, 2022

This issue may belong in was-registrar-app or somewhere else, but it is here for the moment.

When wasSeedPreassemblyWF encounters an error during thumbnail generation a temporary missing.jp2 is written to the object instead of thumbnail.jp2 so that the item will display correctly in PURL and SearchWorks, and the workflow will not quietly get stuck (see #81 #267).

In an ideal world Argo users would be alerted to when workflows that they have initiated have gotten stuck. Until this feature is has been designed & implemented we need to send a report to web archiving curators (Peter Chan) that lists SDR seed objects which need thumbnails to be created and accessioned manually. It might be possible to do this with an SDR database query and some code?

In planning we had talked about several possible approaches to this (maybe there are more):

  • have a notification sent via HoneyBadger (we may be limited in terms of how many active users we have available)
  • run a program via cron that sends an email (similar to what is happening in sul-pub?)
  • build some kind of report into the was-registrar-app

This ticket is to weigh these (and other) options and implement one of them. It may be a good topic for a Spike to try a few things first.

@edsu
Copy link
Contributor Author

edsu commented Jun 27, 2022

The current thinking on this is to see how the improvements to thumbnail generation play out after we go live with pywb, and then revisit this issue if necessary.

@lwrubel
Copy link
Contributor

lwrubel commented Jul 14, 2022

We will continue to monitor the workflow using the workflow grid and errors raised in wasSeedPreassembly. If we decide to go forward, we could create a script to run daily to look for missing.jp2 and email a webarchiving list. also have Honeybadger create a notification.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement hold for PO review PO needs to sign off before merge web archiving for June-July 2022 work cycle
Projects
None yet
Development

No branches or pull requests

3 participants