move untruncated_ids to GPU to fix tensor device mismatch error #8
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
in SDXL-LoRA-RNPD.ipynb, when
External_Captions
is set toTRUE
and captions exceed 77 tokens, it will cause a device mismatch and result in not training the TE for all the epochs that have been specified (it stops after 1 epoch), and instead move on to train the Unet. the text_input_ids tensor is moved to GPU (as seen in the line text_input_ids = text_inputs.input_ids.to(text_encoder.device)), while untruncated_ids stays on the CPU.to fix the error untruncated_ids must be moved to the GPU, the same device as text_input_ids, before the comparison: