[8u40] backport RFR (S): 8051344: JVM crashed in Compile::start() during method parsing w/ UseRTMDeopt turned on

[Vladimir Kozlov]

8u40 backport request. The fix was pushed into jdk9 more then week ago 
and nightly testing shows no related problems.

Changes from jdk9 applied to 8u without conflicts. Tested with new test.

http://hg.openjdk.java.net/jdk9/hs-comp/hotspot/rev/4f55d92a7b97
https://bugs.openjdk.java.net/browse/JDK-8051344
http://cr.openjdk.java.net/~fzhinkin/8051344/webrev.01/

Thanks,
Vladimir