Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restrict unrolling to loops that are nested within less than 4 loops #1595

Merged
merged 4 commits into from
Oct 11, 2024

Conversation

karoliineh
Copy link
Member

@karoliineh karoliineh commented Oct 8, 2024

This PR addresses the excessive resource usage introduced in bb6f9aa.

As the amount of unrolling grows exponentially with the number of nested loops, we determined what would be a reasonable amount of nestings with a 5s run on the sv-benchmarks and found that unrolling less than 4 loops is a reasonable metric.

On the downside, this PR introduces an issue where some termination tasks do not reach a fixpoint. Unfortunately, I was not able to trace it to the cause, but we made a quick run, and it seems to not impact our overall scores (compared to SV-COMP 2023, we lost 2 termination tasks, but we also currently run out of resources for these).

So, (hopefully) this PR fixes more things than it breaks. Edit: we made a run and, indeed, this PR does not break anything else but fixes the excessive resource usage with 717 tasks going from errors back to unknowns.

as unrolling and analyzing empty loops is cheaper than visiting loops for collecting the nr of the instructions
@karoliineh karoliineh added sv-comp SV-COMP (analyses, results), witnesses performance Analysis time, memory usage labels Oct 8, 2024
@karoliineh karoliineh added this to the SV-COMP 2025 milestone Oct 8, 2024
@karoliineh karoliineh requested a review from sim642 October 8, 2024 10:51
@karoliineh karoliineh self-assigned this Oct 8, 2024
@sim642
Copy link
Member

sim642 commented Oct 11, 2024

On the downside, this PR introduces an issue where some termination tasks do not reach a fixpoint

For reference, in SV-COMP 2024 we also had a bunch of fixpoint errors: https://sv-comp.sosy-lab.org/2024/results/results-verified/goblint.results.SV-COMP24.table.html#/table?filter=0(0*status*(status(in(ERROR%20%28verify%29)))).
Most of them are also with the termination property, so there's probably some preexisting underlying issue that less unrolling also triggers.

@sim642 sim642 merged commit cda9ec4 into master Oct 11, 2024
21 checks passed
@sim642 sim642 deleted the no-unrolling-resource branch October 11, 2024 07:46
sim642 added a commit to sim642/opam-repository that referenced this pull request Nov 28, 2024
CHANGES:

Functionally equivalent to Goblint in SV-COMP 2025.

* Add 32bit vs 64bit architecture support (goblint/analyzer#54, goblint/analyzer#1574).
* Add per-function context gas analysis (goblint/analyzer#1569, goblint/analyzer#1570, goblint/analyzer#1598).
* Adapt automatic static loop unrolling (goblint/analyzer#1516, goblint/analyzer#1582, goblint/analyzer#1583, goblint/analyzer#1584, goblint/analyzer#1590, goblint/analyzer#1595, goblint/analyzer#1599).
* Adapt automatic configuration tuning (goblint/analyzer#1450, goblint/analyzer#1612, goblint/analyzer#1181, goblint/analyzer#1604).
* Simplify non-relational integer invariants in witnesses (goblint/analyzer#1517).
* Fix excessive hash collisions (goblint/analyzer#1594, goblint/analyzer#1602).
* Clean up various code (goblint/analyzer#1095, goblint/analyzer#1523, goblint/analyzer#1554, goblint/analyzer#1575, goblint/analyzer#1588, goblint/analyzer#1597, goblint/analyzer#1614).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Analysis time, memory usage sv-comp SV-COMP (analyses, results), witnesses
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants