<i18n dev> Codereview request for 7130915: File.equals does not give expected results when path contains Non-English characters on Mac OS X
Xueming Shen
xueming.shen at oracle.com
Fri Jun 22 10:01:10 PDT 2012
Hi
Here is the proposed change to support Unicode nfd/nfc and case insensitive
file path on MacOSX file system.
7130915: File.equals does not give expected results when path contains
Non-English characters on Mac OS X
7168427: FileInputStream cannot open file where the file path contains
asian characters [macosx]
While these two bug reports are only against java.io, we have the same
issue in javax.nio.file.
Here is the webrev
http://cr.openjdk.java.net/~sherman/7130915_7168427/webrev/
Here is the brief summary of the changes
java.io.File:
(1) removed nfc->nfd conversion in io_util.h/WITH_PLATFORM_STRING, which
means
we are now passing nfc/composite characters directly into macosx
file system APIs
without normalize them to nfd. It appears macosx fs APIs do take
nfc, though it uses
nfd.
(2) normalize the resulting file name from macosx fs APIs from nfd->nfd
before passing
back to java.io.File (File.list() and canonicalize()), so we deal
with nfdc file name
(as "usual") for java.io classes/APIs.
(3) fs.compare()/hashCode() was updated to be case insensitive
(4) hasCode() was updated to use the new String.hash32().
java.nio.file:
(5) added a setof MacOSXFile... on top of existing BsdFile... classes.
An alternative is to
update those BsdFile... classes directly to address the macosx specific
issues. But given
there might be developers over there might work on open jdk BSD port and
have dependency
on these classes, it might be desirable to have another separate layer
of MacOSXFile...
classes. So now the default FileSystem/Provider is
MacOSXFileSystemProvider and
MacOSXFileSystem.
(6) the "main" changes are in MacOSXFileSystem, in which the
corresponding methods
were added to handle, case insensitive and nfd<=>nfc normalization,
including the
pathmatcher.
(7) compare is now are case-insensitive
(8) hashCode is now murmur3_32(), this is true for all
Solaris/Unix/Linux and maxosx.
Though lots of files have been touched, but the line of changes are
actually relatively
small.
The proposed change only deals with the default case-sensitiveness
seting, which is
case insensitive. On MaxOSX, you actually can configure the HFS+ file
system or the
mounted vol to be case-sensitive. A possible approach is to have some
extra FileStore
attributes, such as a isCaseSensitive and to use case sensitive
compare/equal on
such fs, but this can be dealt with separately later.
Thanks,
-Sherman
More information about the i18n-dev
mailing list