Skip to content

Commit

Permalink
update weight map
Browse files Browse the repository at this point in the history
  • Loading branch information
grimoire committed Dec 15, 2023
1 parent f79e080 commit 0935ddb
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions lmdeploy/turbomind/deploy/target_model/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -84,9 +84,7 @@ def valid(self):


_WEIGHT_DTYPE_MAP = dict(
w4=torch.float16,
int4=torch.float16,
half=torch.float16,
fp16=torch.float16,
fp32=torch.float16,
bf16=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16,
Expand Down

0 comments on commit 0935ddb

Please sign in to comment.