Skip to content

A benchmarking suite for evaluating performance of compressed LLaMA models focused on finding an optimal balance between different pruning and quantization techniques with varying number of model parameters

Notifications You must be signed in to change notification settings

GokulVSD/MidLLaMAI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MidLLaMAI

Steps & Dependencies:

Conda environment Python3.11

conda install nvidia/label/cuda-12.1.0::cuda

conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

Then install whatever pip dependencies you get as complaints when running the below scripts.

For chatting: python prompt.py

For benchmarking: python benchmark.py

About

A benchmarking suite for evaluating performance of compressed LLaMA models focused on finding an optimal balance between different pruning and quantization techniques with varying number of model parameters

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published