Collectors.toSet() small performance improvement
Tagir F. Valeev
amaembo at gmail.com
Wed Aug 17 03:08:37 UTC 2016
Hello, Paul!
Thank you. Here's issue:
https://bugs.openjdk.java.net/browse/JDK-8164189
And webrev:
http://cr.openjdk.java.net/~tvaleev/webrev/8164189/r1/
With best regards,
Tagir Valeev.
PS> Hi Tagir,
PS> I like it. Please open an issue and i will sponsor the fix for you.
PS> Thanks,
PS> Paul.
>> On 8 Aug 2016, at 22:31, Tagir F. Valeev <amaembo at gmail.com> wrote:
>>
>> Hello!
>>
>> I'd like to propose a simple performance patch for Collectors.toSet():
>>
>> --- a/src/java.base/share/classes/java/util/stream/Collectors.java Tue Aug 02 07:19:06 2016 +0530
>> +++ b/src/java.base/share/classes/java/util/stream/Collectors.java Tue Aug 09 11:47:20 2016 +0700
>> @@ -295,7 +295,12 @@
>> public static <T>
>> Collector<T, ?, Set<T>> toSet() {
>> return new CollectorImpl<>((Supplier<Set<T>>) HashSet::new, Set::add,
>> - (left, right) -> { left.addAll(right); return left; },
>> + (left, right) -> {
>> + if (left.size() < right.size()) {
>> + right.addAll(left); return right;
>> + }
>> + left.addAll(right); return left;
>> + },
>> CH_UNORDERED_ID);
>> }
>>
>> This will add the smaller set to the larger which may improve parallel
>> performance when subtasks produced uneven results. In normal case the
>> additional overhead is insignificant (additional HashSet size
>> comparison per each combine operation which usually performed
>> ~4*parallelism times).
>>
>> Here's simple JDK benchmark with results (Core-i7-4702MQ 4 HT cores,
>> Win7, JDK 9-ea+129 64bit) which confirms the speedup:
>> http://cr.openjdk.java.net/~tvaleev/patches/toSet/
>>
>> When data is unevenly distributed, it's significantly faster:
>>
>> Original:
>> ToSet.toSetParallel 10000 true avgt 50 88,580 ± 0,874 us/op
>> ToSet.toSetParallel 100000 true avgt 50 676,243 ± 41,188 us/op
>> ToSet.toSetParallel 1000000 true avgt 50 9126,399 ± 83,260 us/op
>> Patched:
>> ToSet.toSetParallel 10000 true avgt 50 62,121 ± 1,207 us/op
>> ToSet.toSetParallel 100000 true avgt 50 556,968 ± 37,404 us/op
>> ToSet.toSetParallel 1000000 true avgt 50 6572,372 ± 183,466 us/op
>>
>> When data is evenly distributed, no statistically significant changes
>> observed:
>>
>> Original:
>> ToSet.toSetParallel 10000 false avgt 50 177,137 ± 5,941 us/op
>> ToSet.toSetParallel 100000 false avgt 50 2056,332 ± 87,433 us/op
>> ToSet.toSetParallel 1000000 false avgt 50 51864,198 ± 560,883 us/op
>> Patched:
>> ToSet.toSetParallel 10000 false avgt 50 172,606 ± 7,321 us/op
>> ToSet.toSetParallel 100000 false avgt 50 1922,478 ± 79,593 us/op
>> ToSet.toSetParallel 1000000 false avgt 50 52648,100 ± 621,526 us/op
>>
>> What do you think? Should I open an issue?
>>
>> With best regards,
>> Tagir Valeev.
>>
More information about the core-libs-dev
mailing list