<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Hi Vitaly,</div><div id="AppleMailSignature"><br></div><div id="AppleMailSignature">I wanted to acknowledge your email and we will review your questions and get back to you soon.<br><br>Thanks,<div>Sandeep</div></div><div><br>On Oct 3, 2016, at 7:35 PM, Vitaly Provodin <<a href="mailto:vitaly.provodin@jetbrains.com">vitaly.provodin@jetbrains.com</a>> wrote:<br><br></div><blockquote type="cite"><div><meta http-equiv="Content-Type" content="text/html charset=us-ascii"><p class="gmail-p1"><span class="gmail-s1">Hello,</span></p><p class="gmail-p2">My question relates to failures of the Regression tests (jdk/test) on OpenJDK8 and how to identify whether a failure is expected or not.</p><p class="gmail-p2">Running java/awt and javax/swing tests against OpenJDK8 on various platforms I got some failures. Trying to find any explanations for these failures I looked through the JDK Bug System and could not find any bugs explaining them, for example, for the following two tests</p><p class="gmail-p3"><i class="">-java/awt/Frame/UnfocusableMaximizedFrameResizablity/UnfocusableMaximizedFrameResizablity.java</i><br class=""></p><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-style: solid; border-left-color: rgb(204, 204, 204); padding-left: 1ex;"><span class="gmail-s1">Failed.<br class=""></span><span class="gmail-s1">Program `/Users/builduser/buildAgent/work/13ab0d4c51b0de0b/jbsdk/jdk/Contents/Home/bin/java' timed out (timeout set to 240000ms, elapsed time was 240786ms).</span></blockquote><p class="gmail-p3"><span class="gmail-s1"><i class=""></i></span></p><p class="gmail-p5"><i class="">- javax/swing/JPopupMenu/6800513/bug6800513.java</i><br class=""></p><div class=""><span class="gmail-s1"></span><br class="webkit-block-placeholder"></div><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-style: solid; border-left-color: rgb(204, 204, 204); padding-left: 1ex;">Failed.<br class=""><span class="gmail-s1">Execution failed: `main' threw exception: java.lang.Exception: popup class is: javax.swing.PopupFactory$HeavyWeightPopup, expected: javax.swing.PopupFactory$LightWeightPopup</span></blockquote><div class=""><span class="gmail-s1"></span><br class="webkit-block-placeholder"></div><div class=""><p class="gmail-p5">I found out that these tests were excluded from runs against JDK 8 Update Releases Early Access Build (EAB) - see Test Results page at <a href="http://download.java.net/openjdk/testresults/8" class="">http://download.java.net/openjdk/testresults/8</a>. Please note, I do not know the status of these results, whether they are actual for OpenJDK8 final release or not. Also, I paid attention to that most of the failures I am talking about are not included into jdk/test/ProblemList.txt as for now.</p><p class="gmail-p5">Supposing once these tests were excluded from runs, there were some causes for that e.g. some known product or test issues which were not intended to be fixed for this particular release. My question is how can I get to know these causes in order to <span style="font-size: 13px; white-space: nowrap;" class="">differentiate expected and </span>unexpected failures - any of these tests, which were excluded from EAB runs because of one issue, may fail because of another.</p><p class="gmail-p5">I tried to follow the link at Summary column placed on the page <a href="http://download.java.net/openjdk/testresults/9" class="">http://download.java.net/openjdk/testresults/9</a> and could not get information about statuses of the tests (similar to OpenJDK8). So another question, how can I get the list of regression tests (if any) which expectedly fail for some particular OpenJDK release?</p><p class="gmail-p5">Thanks,<br class=""></p><p class="gmail-p5">Vitaly </p></div></div></blockquote></body></html>