Running ide/projectui tests in the CI checks

[jtulach]

• enabling projectui tests in the CI
  • really fails in org.netbeans.modules.project.ui.ProjectUtilitiesTest - fixed in 1328e4b
  • and org.netbeans.modules.project.ui.ProjectsRootNodeTest - fixed in 64b8585
  • and org.netbeans.modules.project.ui.ProjectsRootNodeInitializedSoonerTest - removed
• fixing the failing tests
• ide/projectui tests are successfully running on the CI
• the tests executed 37 times successfully on my local machine

[jtulach]

I squash my commits and integrate.

[mbien]

please use CI resources responsibly. We don't have to run all jobs in PRs which modify tests of a single module. Unless those are base files or there are other risks of side effects . The ide job is always active so this should run if I see this correctly.

Also when activating a new set of tests, I would recommend to run them in a loop a little bit to check if they are reliable in case this hasn't been done yet. We continue to have stability issues in CI - tracking them down is time consuming (#8183).

[jtulach]

please use CI resources responsibly. We don't have to run all jobs in PRs which modify tests of a single module

For a while I wasn't sure what this comment is about, but now I know...

@mbien) removed the ci:all-tests label

OK. That's fair. We don't need to run other tests if the changes are only in projectui module.

[jtulach]

Also when activating a new set of tests, I would recommend to run them in a loop ... to check if they are reliable

With 68a9f6d I executed:

netbeans$ ROUND=1; while ant -f ide/projectui test -Dtest-unit-sys-prop.ignore.random.failures=true; do ROUND=`expr $ROUND + 1`; echo Done round $ROUND; sleep 3; done
...
Done round 37

e.g. 37 successful subsequent runs. I guess that's good enough to enter the CI, right @mbien?

[lahodaj]

Looks good.

[jtulach]

Looks good.

Thanks. Squashed and will commit once the CI is green again.

[mbien]

e.g. 37 successful subsequent runs. I guess that's good enough to enter the CI, right @mbien?

sounds good to me, thanks for checking before integration