This repository has been archived by the owner on Dec 16, 2022. It is now read-only.
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Hi,
I wonder if anybody has done a (language, token) frequency list from the mc4? It will take a lot of resources to download and tokenise (including non-spaced languages) the whole dataset, so it would be nice if somebody already did this?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions