Empty regexp replaceall and surrogate pairs results in corrupted utf16.
Dawid Weiss
dawid.weiss at gmail.com
Thu Jun 7 20:07:07 UTC 2012
Hi, I'm a committer to the Apache Lucene project. We have randomized
tests and one seed hit the following (simplified) scenario:
String s1 = "AB\uD840\uDC00C";
String s2 = s1.replaceAll("", "X");
the input contains an extended unicode character (any surrogate pair
will do). The pattern is an empty string (in fact, it was randomized
as "]|" but it's the same problem so I omit the details). The problem
is that after applying this pattern, replaceAll inserts X in between
the surrogate pair characters and this results in invalid UTF-16:
ABC
XAXBX?X?XCX
I believe this is a bug in the regexp implementation (sorry, don't
have a patch for it) but I'd like to confirm it's not something known.
Pointers appreciated.
Dawid
More information about the core-libs-dev
mailing list