Intermittent acceptance test quota failures

[phil-davis]

We are seeing webUI acceptance tests sometimes fail on drone. e.g.

  Scenario Outline: change quota to an invalid value                                                          # /var/www/owncloud/apps/user_management/tests/acceptance/features/webUIManageQuota/manageUserQuota.feature:38
    When the administrator changes the quota of user "user1" to "<wished_quota>" using the webUI              # WebUIUsersContext::theAdministratorSetsTheQuotaOfUserUsingTheWebUI()
    Then a notification should be displayed on the webUI with the text 'Invalid quota value "<wished_quota>"' # WebUIGeneralContext::aNotificationShouldBeDisplayedOnTheWebUIWithTheText()
    And the quota of user "user1" should be set to "Default" on the webUI                                     # WebUIUsersContext::quotaOfUserShouldBeSetToOnTheWebUI()

    Examples:
      | wished_quota |
      | stupidtext   |
SCENARIO RESULT: (fail)
      | 34,54GB      |
        Failed asserting that two strings are equal.
        --- Expected
        +++ Actual
        @@ @@
        -'Invalid quota value "34,54GB"'
        +''
SCENARIO RESULT: (fail)
      | 30/40GB      |
        Failed asserting that two strings are equal.
        --- Expected
        +++ Actual
        @@ @@
        -'Invalid quota value "30/40GB"'
        +''
SCENARIO RESULT: (fail)
      | 30/40        |
        Failed asserting that two strings are equal.
        --- Expected
        +++ Actual
        @@ @@
        -'Invalid quota value "30/40"'
        +''
SCENARIO RESULT: (fail)
      | 3+56 B       |
        Failed asserting that two strings are equal.
        --- Expected
        +++ Actual
        @@ @@
        -'Invalid quota value "3+56 B"'
        +''
SCENARIO RESULT: (pass)
      | -1 B         |

--- Failed scenarios:

    /var/www/owncloud/apps/user_management/tests/acceptance/features/webUIManageQuota/manageUserQuota.feature:46
    /var/www/owncloud/apps/user_management/tests/acceptance/features/webUIManageQuota/manageUserQuota.feature:47
    /var/www/owncloud/apps/user_management/tests/acceptance/features/webUIManageQuota/manageUserQuota.feature:48
    /var/www/owncloud/apps/user_management/tests/acceptance/features/webUIManageQuota/manageUserQuota.feature:49

Probably a UI timing issue.

[phil-davis]

This seems to not be happening nowadays, probably because various acceptance test timing issues have been improved in core.

But now the acceptance tests are failing on the next step of the scenario. See issue #100

[individual-it]

closing?