RFR: 8365994: ZGC: Incorrect type signature in ZMappedCache comparator

[Albert Mingkun Yang]

On Fri, 22 Aug 2025 15:08:42 GMT, Joel Sikström <jsikstro at openjdk.org> wrote:

> Hello,
> 
> The comparator with two IntrusiveRBNode* in ZMappedCache has the incorrent type signature. This prevents IntrusiveRBTree from using the comparator as intended during validation, resulting in it using the fallback verify function, which always returns true. This could mask potential issues in the tree structure. 
> 
> Testing:
> * Manually placing an assert in the fallback verify function to see if it is used. It is no longer used with this patch.
> * Oracle's tier 1-2

src/hotspot/share/gc/z/zMappedCache.hpp line 44:

> 42:   struct EntryCompare {
> 43:     static int cmp(zoffset a, const IntrusiveRBNode* b);
> 44:     static bool cmp(const IntrusiveRBNode*  a, const IntrusiveRBNode* b);

I'd expect `cmp` to return `int`; otherwise, the `cmp` name is rather misleading. I wonder if rbtree can be changed so that all `cmp` methods return `int` instead.

-------------

PR Review Comment: https://git.openjdk.org/jdk/pull/26904#discussion_r2298236455