Integrated: 8253904: Revert Tokenizer improvements JDK-8224225

[Jim Laskey]

On Thu, 1 Oct 2020 17:35:27 GMT, Jim Laskey <jlaskey at openjdk.org> wrote:

> This reverts commit 90c131f29f23ba1be2c5ac50a780d39a752e2444.
> 
> Github test gave false positive.
> 
> https://bugs.openjdk.java.net/browse/JDK-8253904
> 
> https://github.com/JimLaskey/jdk/actions/runs/282419921
> 
> 
> Sorry for the inconvenience.

This pull request has now been integrated.

Changeset: 8fda5b82
Author:    Jim Laskey <jlaskey at openjdk.org>
URL:       https://git.openjdk.java.net/jdk/commit/8fda5b82
Stats:     2336 lines in 18 files changed: 586 ins; 1102 del; 648 mod

8253904: Revert Tokenizer improvements JDK-8224225

Reviewed-by: mcimadamore

-------------

PR: https://git.openjdk.java.net/jdk/pull/471