Fallback to archive site for removed global Twitch emotes

[superbonaci]

Checklist

• I have checked the issue page for duplicates
• I am running the latest version (download here)

Edition

Command Line Interface

Describe your issue here

Older chats got the emote removed even if it hadn't expired back then. So the url for the image is there but can't be downloaded:

$ TwitchDownloaderCLI chatdownload -E -u 2262876737 -o 2262876737.html
$ TwitchDownloaderCLI chatdownload -E -u 2262876737 -o 2262876737.json

• The emote url in the html is: https://static-cdn.jtvnw.net/emoticons/v2/86/default/dark/1.0 but it's offline.
• It can downloaded from here:
  https://web.archive.org/web/20240928145854/https://static-cdn.jtvnw.net/emoticons/v2/86/default/dark/1.0
  https://web.archive.org/web/20240928145714/https://static-cdn.jtvnw.net/emoticons/v2/86/default/dark/2.0
  https://web.archive.org/web/20240928145956/https://static-cdn.jtvnw.net/emoticons/v2/86/default/dark/3.0
• The json also has the id

This could happen also to other images. If TwitchDownlaoderCLI can't get the images from twitch it can try from Web Archive.
This affects chatdownload chatupdate chatrender.

chats:
2262876737.html.zip
2262876737.json.zip

Add any related files or extra information here

2262876737

[ScrubN]

I like the idea of restoring deleted Twitch emotes such as BibleThumb, PogChamp, and BlessRNG, I also don't really want to keep a hard coded list of removed emotes that fallback to archive.org. Maybe I'll change my stance on it later.

[superbonaci]

Also OMGScoots.
You could store the images in an assets folder in the project, but I don't know if that is legal. But if you did that you could do it with all emotes, and the program will be much faster.

If you don't hard code the list of removed emotes in the program the only thing you can do is to connect to a website that lists all the removed emotes, and is updated. But I don't know of such website and I don't think it will ever exist.

Using archive.org is simple and fixes the problem now, you can even keep a list of urls for each removed emote in case archive.org closes or something.

[Mishasama]

Perhaps you can try hosting a service on GitHub.io to cache all these emote images and their corresponding keywords. This way, when the program encounters an emote image that cannot be found on Twitch, it can attempt to search for the corresponding emote image in this service by using keywords from the already downloaded chat files, and if found, download and use it.

[superbonaci]

It only depends if ScrubN wants to fix it or not.