Random crashes using Frigate

[raelbsd]

Hi guys, I'm facing some random errors in my setup, maybe you can give me some advice to fix them.
My cam is a Wyze Cam V3, I'm using wz_mini_hacks with RTSP disabled and go2rtc enabled, and standalone mode. This camera is in a straight line to the next Mikrotik router (5 meters away) so the wifi signal is good.
On the server side I'm running Frigate on Docker within a Proxmox VM running Ubuntu 22.04.3. I have some Google Corals and the video card for HW acceleration are passed through from the host to the VM, everything is wired.
The cam seems to give timeout from time to time. That leads into several errors after that in Frigate (ffmpeg encoding errors, process errors, etc.) I tried to search for errors from the camera side, I see everything fine from the webserver menu (Go2RTC Server->Logs) but from the ssh console I've found some errors running all the time:

[root@cam-cocina:~]# tail -f  /opt/wz_mini/log/go2rtc.log
DTS 63700706308617, next:28672356078 st:0 invalid droppingate=N/A speed=   1x
PTS 63700706308617, next:28672356078 invalid dropping st:0
DTS 63700706448052, next:28672481078 st:0 invalid dropping
PTS 63700706448052, next:28672481078 invalid dropping st:0
DTS 63700706557325, next:28672606078 st:0 invalid dropping
PTS 63700706557325, next:28672606078 invalid dropping st:0
DTS 63700706697435, next:28672731078 st:0 invalid dropping
PTS 63700706697435, next:28672731078 invalid dropping st:0
DTS 63700706804029, next:28672856078 st:0 invalid droppingate=N/A speed=   1x

I'm not sure if this is ok, or if I can raise the logging to find the issue somewhere else.
I have several cams with the same error so I reduced the configuration to the minimum to isolate this error.
I configured on the crontab's camera a daily reboot.
The cam is detectec as a T31, and the FW version of the camera is 4.36.9.131.
Thanks in advance!

[BaIanced]

Mine are doing this as well. I use the go2rtc with rtsp disabled and stream a live feed to the kitchen dish area so I can see if customers come to counter. It's constantly going through a stop/start cycle. The stream can last for a while (a while meaning 20min) but then goes blank and you have to wait for about a minute before go2rtc spins back up. The issue only begun after adding the forced update bypass but it may not be correlated . I'm not using frigate btw, just accessing stream from web browser. I can get logs, none of it makes a lot of sense to me.

I have noticed the timeout seems to occur when motion happens in the frame.