tts onnx gpu inference time problems

[1nlplearner]

hi, i met a problem when onnx inference on gpu

1. onnx inference on gpu slower than onnx cpu inference much time and sometimes faster than gpu pt inference(2 times acceleration)
2. when i inference same text twice or more, inference achieves 2 time acceleration compare to gpu pt inference
   any advicec?
   thanks

[Masao-Someki]

@1nlplearner
At the first execution, onnxruntime takes a longer time for inference. So please skip the first execution.

[1nlplearner]

@1nlplearner At the first execution, onnxruntime takes a longer time for inference. So please skip the first execution.
i think this is the reason, [Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.]
how to solve it?
thanks