New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix autocast to support global tensor #10605

Open

fpzh2011 wants to merge 2 commits into master from autocast_global_tensor

Contributor

fpzh2011 commented Dec 18, 2024

oneflow autocast 不支持 global tensor。下面代码直接报错

import oneflow as flow

placement = flow.placement("cuda", ranks=[0])
sbp = flow.sbp.broadcast
a = flow.randn(2, 3).to_global(placement=placement, sbp=sbp)
b = flow.randn(3, 4).to_global(placement=placement, sbp=sbp)
with flow.autocast(device_type="cuda"):
    c = flow.matmul(a, b)


          fix autocast to support global tensor

bc67ecb

fpzh2011 requested review from hjchen2 and strint as code owners

December 18, 2024 02:45


          Merge branch 'master' into autocast_global_tensor

411a930

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet