Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ValueError: invalid literal for int() with base 10: '90a' #361

Open
MatthewCroughan opened this issue Dec 24, 2024 · 0 comments
Open

ValueError: invalid literal for int() with base 10: '90a' #361

MatthewCroughan opened this issue Dec 24, 2024 · 0 comments

Comments

@MatthewCroughan
Copy link

>>> import torch
>>> print(torch.cuda.get_arch_list())
['sm_60', 'sm_61', 'sm_70', 'sm_75', 'sm_80', 'sm_86', 'sm_89', 'sm_90', 'sm_90a']
  File "/home/matthew/git/ai-toolkit/toolkit/optimizers/optimizer_utils.py", line 4, in <module>
    from optimum.quanto import QBytesTensor
  File "/nix/store/ymj1w34dfw2bi3ai9njyxg2q5fr4r18h-python3.12-optimum-quanto-66dca87bc7e61ffbf1a06da9fd324469592e17e9/lib/python3.12/site-packages/optimum/quanto/__init__.py", line 18, in <module>
    from .library import *
  File "/nix/store/ymj1w34dfw2bi3ai9njyxg2q5fr4r18h-python3.12-optimum-quanto-66dca87bc7e61ffbf1a06da9fd324469592e17e9/lib/python3.12/site-packages/optimum/quanto/library/__init__.py", line 15, in <module>
    from .extensions import *
  File "/nix/store/ymj1w34dfw2bi3ai9njyxg2q5fr4r18h-python3.12-optimum-quanto-66dca87bc7e61ffbf1a06da9fd324469592e17e9/lib/python3.12/site-packages/optimum/quanto/library/extensions/__init__.py", line 23, in <module>
    from .cuda import *
  File "/nix/store/ymj1w34dfw2bi3ai9njyxg2q5fr4r18h-python3.12-optimum-quanto-66dca87bc7e61ffbf1a06da9fd324469592e17e9/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/__init__.py", line 54, in <module>
    quanto_cuda_arch = get_max_cuda_arch()
                       ^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ymj1w34dfw2bi3ai9njyxg2q5fr4r18h-python3.12-optimum-quanto-66dca87bc7e61ffbf1a06da9fd324469592e17e9/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/__init__.py", line 31, in get_max_cuda_arch
    supported_sm = [int(arch.split("_")[1]) for arch in torch.cuda.get_arch_list() if "sm_" in arch]
                    ^^^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: '90a'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant