RFR: 8243469: Lazily encode name in ZipFile.getEntryPos
Volker Simonis
volker.simonis at gmail.com
Mon Apr 27 09:49:31 UTC 2020
On Sun, Apr 26, 2020 at 11:34 PM Claes Redestad
<claes.redestad at oracle.com> wrote:
>
> Hi again,
>
> On 2020-04-24 21:22, Claes Redestad wrote:
> >> It seems that 'getEntryHitUncached' is getting slightly slower with
> >> your change while all the other variants get significantly faster. I
> >> don't think that's a problem, but do you have an explanation why
> >> that's the case?
> >
> > I've noticed it swing a bit either way, and have been asking myself the
> > same thing. After a little analysis I think it's actually a bug in my
> > microbenchmark: I'm always looking up the same entry, and thus hitting
> > the same bucket in the hash table. If that one has a collision, we'll do
> > a few extra passes. If not, we won't. This might be reflected as a
> > significant swing in either direction.
> >
> > I'm going to try rewriting it to consider more (if not all) entries in
> > the zip file. That should mean the cost averages out a bit.
>
> after I improved my micro to root out sources of variance, the
> performance issue for hits persisted.
>
> Luckily Eirik had a brilliant idea: Why not decode the bytes in the
> cen to a String and compare that, rather than the other way around?
> To some surprise it turns out this gives us about a ~1.2x speedup for
> getEntryHit and getEntryHitUncached over open.00 - and comfortably
> just ahead of the baseline on getEntryHitUncached[1]. It also leads to
> slightly cleaner code[2].
>
> Webrev: http://cr.openjdk.java.net/~redestad/8243469/open.01/
>
> The speed-up appears to come from String.equals, which is intrinsified
> and significantly faster than the replaced loop. I profiled allocation
> per operation and it stays the same (EA removes the String).
>
Great! Another nice improvement. The changes look good to me.
Following just two minor remarks:
In ZipCoder.normalizedHashDecode() you've changed the line:
if (limit > 0 && decoded[limit - 1] != '/') {
to:
if (limit > pos && decoded[limit - 1] != '/') {
which was first a little confusing to me. But in the end it turns out
that this is semantically the same, because the
CharsetDecoder.decode() method called before is guaranteed to return a
"newly-allocated character buffer" and its "position will be zero and
its limit will follow the last character written". This also explains
why you don't have to take the CharBuffer's "arrayOffset()" into
account if you use the CharBuffer's backing array (because it will
always be 0 for newly created buffers). So maybe you can put in some
comments to make it less confusing for the ingenuous reader:
CharBuffer cb = decoder().decode(ByteBuffer.wrap(a, off, end - off));
// 'cb' is a newly allocated CharBuffer with 'pos == 0'
int pos = cb.position();
int limit = cb.limit();
char[] decoded;
if (cb.hasArray()) {
// 'cb.arrayOffset()' is zero for newly allocated CharBuffers
decoded = cb.array();
} else {
decoded = new char[limit - pos];
cb.get(decoded);
}
I think you can also remove the "else" branch (and maybe replace it
with an assertion) because newly allocated CharBuffers are guaranteed
to be backed by an array with array offset zero (see
https://docs.oracle.com/en/java/javase/14/docs/api/java.base/java/nio/CharBuffer.html#allocate(int)
).
Zipcoder.get() seems to be the only remaining if block without braces.
Maybe you'll wnat to fix that once your on it?
public static ZipCoder get(Charset charset) {
if (charset == UTF_8.INSTANCE)
return UTF8;
return new ZipCoder(charset);
Thumbs up from my side. There's no need for a new webrev from my side.
Best regards,
Volker
> Testing: tier1-4
>
> Thanks!
>
> /Claes
>
> [1]
> Baseline:
> Benchmark (size) Mode Cnt Score Error Units
> ZipFileGetEntry.getEntryHit 512 avgt 15 126.264 ± 5.297
> ns/op
> ZipFileGetEntry.getEntryHit 1024 avgt 15 130.823 ± 7.212
> ns/op
> ZipFileGetEntry.getEntryHitUncached 512 avgt 15 152.149 ± 4.978
> ns/op
> ZipFileGetEntry.getEntryHitUncached 1024 avgt 15 151.527 ± 4.054
> ns/op
>
> open.01:
> Benchmark (size) Mode Cnt Score Error
> Units
> ZipFileGetEntry.getEntryHit 512 avgt 15 84.450 ± 5.474
> ns/op
> ZipFileGetEntry.getEntryHit 1024 avgt 15 85.224 ± 3.776
> ns/op
> ZipFileGetEntry.getEntryHitUncached 512 avgt 15 140.448 ± 4.667
> ns/op
> ZipFileGetEntry.getEntryHitUncached 1024 avgt 15 145.046 ± 7.363
>
> [2] I stopped short of taking the cleanup a step further by decoding to
> String even in initCEN, which sadly isn't performance neutral:
>
> http://cr.openjdk.java.net/~redestad/8243469/open.01.init_decode/
>
> Something for the future to consider, maybe.
More information about the core-libs-dev
mailing list