Model doesnt work well on unpaired data

[vandana-sreenivasan3]

Hi,
I train model with train A containing images of people without jewellery and train B contains images of people with jewellery. It works good on images that are paired but doesn't work well with images do not present in train B what can be done for this.