This is the repository for the IC2E 2022 paper which introduces the Crispy resource allocation assistant.
It contains:
- The source code and the evaluation of Crispy
- The main dataset in csv format from the "Arrow" paper by Hsu et al.
- The exploratory data analysis of this main dataset, which served as a motivation for our approach
- The local runtime data set which was gathered during the profiling runs
The full title of the paper is "Get Your Memory Right: The Crispy Resource Allocation Assistant for Large-Scale Data Processing" [PDF]
The authors of the paper are Jonathan Will, Lauritz Thamsen, Jonathan Bader, Dominik Scheinert, and Odej Kao