Adding the argument -s 10 when running the pigpiod daemon will almost half the CPU usage as per this topic.
But this is not the default behavior and will have some disadvantages as well. Read more about this on the link.
My tests show me no degraded functions just as others have reported so I put this into the default runtime.
To reverse back from this add this to your docker-compose.yml file:
command: pigpiod -g -a 1 # For 32 bits
command: pigpiod -g # For 64 bits