Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gauss-mix randomly fails on CI #457

Open
vhotspur opened this issue Nov 13, 2024 · 1 comment
Open

gauss-mix randomly fails on CI #457

vhotspur opened this issue Nov 13, 2024 · 1 comment

Comments

@vhotspur
Copy link
Member

Randomly but quite often (I would say one in five builds, perhaps) gauss-mix benchmark fails when run as part of the CI.

It does not fail with some assertion/exception but rather stays in some endless loop (probably) as the job time-outs without any apparent reason (just gauss-mix is the last benchmark that was started).

From my experience this happens more often (maybe only?) in the standalone runs, i.e. when the main (fat) JAR is unpacked and we run single/gauss-mix.jar directly.

I was unable to reproduce the failure locally (even using the build artifact). At the moment it happily runs for several days on my machine without a glitch.

I do not expect we would solve this any time soon but it should be known at least.

@lbulej
Copy link
Member

lbulej commented Nov 13, 2024

I also could not reproduce it locally, I saw it first in CI which has much less resources :-(

vhotspur added a commit that referenced this issue Nov 20, 2024
Each benchmark is now run like this:

    timeout --signal=SIGQUIT 5m java ...

Thus threads are dumped on timeout which should help debugging.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants