Clarification regarding the GitHub Actions pre-submit testing
Ioi Lam
ioi.lam at oracle.com
Fri Mar 19 00:28:38 UTC 2021
One problem with GHA is the frequent false negatives. I think if we can
reduce that, people will be more willing to trust the results of the GHA
runs.
[1] Intermittent failures due to machine configuration. Some of those
are network related (e.g., multi casting). Some are related to user
privileges (process attachment). Etc.
My feeling is that such environment-sensitive tests are a very minor
part of the overall tests. Maybe we can have a GHA-specific problem list
to exclude these tests?
If you are touching these areas, you will need to test your changes
using other means. However, I think this affects only a small number of
JDK contributors.
[2] Random build failures, apparently due to toolchain variation. I've
seen this quite a few times in the past week.
This doesn't seem to be specific to OpenJDK. I assume many other
projects use GHA as well. How do they handle this situation?
Any other type of issues?
Thanks
- Ioi
More information about the jdk-dev
mailing list