[Request] Release BF16 version of 0.6B 1024x model

[Bocchi-Chan2023]

Hi, I was so impressed with the quality of your 0.6b 1024x model that I tried to train it, but it disintegrated immediately. Is it possible to release a BF16 model like the other sizes?

[lawrence-cj]

Sure. blocked by other thing recently. will release later.

[Bocchi-Chan2023]

Sure. blocked by other thing recently. will release later.

Thanks, I'll look forward for it.
can you tell me how to make bf16 models from scratch? (or how to make empty model?) I'll try to train too

[lawrence-cj]

Does the training guidance work for you?

https://github.com/NVlabs/Sana#-3-how-to-train-sana

[Bocchi-Chan2023]

Does the training guidance work for you?

https://github.com/NVlabs/Sana#-3-how-to-train-sana

it seems to be working, but unfortunately, I got oom at training...
maybe I'll try it on runpod