Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Archive shorturls dumps #8

Open
legoktm opened this issue Jul 13, 2020 · 2 comments
Open

Archive shorturls dumps #8

legoktm opened this issue Jul 13, 2020 · 2 comments

Comments

@legoktm
Copy link

legoktm commented Jul 13, 2020

Hi, would it be possible to back up the shorturls dumps (https://dumps.wikimedia.org/other/shorturls/) to archive.org? @nemobis pointed me in your direction.

@Hydriz
Copy link
Owner

Hydriz commented Jul 14, 2020

Yep it's definitely possible. However, I am in the midst of rewriting the backend to be more robust so it will take some time before the files appear on Archive.org, along with the other datasets that Wikimedia provides.

@legoktm
Copy link
Author

legoktm commented Jul 15, 2020

Awesome. How long do you think that will take? We want to start cleaning up the old shorturls dumps (see https://phabricator.wikimedia.org/T257782). If it's going to be a while, I can back them up to IA manually for now until your system is ready.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants