Random Pruning Method

This is the official implementation of paper "Breaking through Deterministic Barriers: Randomized Pruning Mask Generation and Selection"

Data Preparation

please refer to the data preparation of TinyBert

https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TinyBERT

Run Experiments for MRPC

cd mrpc
bash run_experiment_mrpc_determinstic.sh 0
bash run_experiment_mrpc_random_quickcall.sh 0

please replace the dataset file path with your own.

Note

This repo is not perfect so far, more details will be added recently.