Big delays when building an amd64 image on an arm VM using buildx

[EvgeniaPatsoni]

Hello

I am building a multi-arch (arm64 and amd64) Docker image using buildx for a frontend application, on an ARM machine on Azure.
When the arm64 architecture is being built it completes almost immediately, as expected.
When the amd64 architecture is being built, the RUN npm install --no-audit stage of the pipeline more than 1 hour and eventually fails with a npm ERR! errno ECONNRESET error.

In addition, on the same ARM machine I am building a multi-arch (arm64 and amd64) Docker image using buildx for the backend of the application as well, but I have not faced any delays there. Both archs are being build in the same time frames. I only face increased delays with the npm install command.

I understand that emulation can be adding some delay but is this extreme behavior normal?
Is there something I can do to reduce build times?

I can attach the Dockerfiles or logs if necessary.

Thank you in advance