Large organization support

[paulslaby]

I have a problem. I want to distribute a small portion of files (currently one) into a large number of repositories. I am hitting the limit 10GB of disk space on the worker.
Possible solutions I see:

• no cloning of the target repo (we can create a PR directly via API)
• deleting the cloned repo after processing is done (quickwin, but breaks caching possibility)
• splitting repositories into batches and run batches in distinct runs

[derberg]

10GB of disk space

😅

we can create a PR directly via API

didn't know that is possible. Not sure how that would work though

deleting the cloned repo after processing is done (quickwin, but breaks caching possibility)

I think this one is easiest and caching is probably not a big deal

[paulslaby]

I rewrote it in a fork in our company: https://github.com/customink/manage-files-in-multiple-repositories
Feel free to get inspired, or anything you want. But i think those changes are too big to create a PR.