[foreign-memaccess+abi] RFR: Improve performance of Arena::allocateFrom

[Maurizio Cimadamore]

On Tue, 1 Aug 2023 11:14:25 GMT, Maurizio Cimadamore <mcimadamore at openjdk.org> wrote:

> This patch improves the performance of allocation of a standard confined/shared arenas in two steps:
> 
> * first, it special cases the allocation methods in SegmentAllocator to detect the case where the SegmentAllocator implementation is the internal Arena implementation. In such case, all the `allocateFrom` methods attempt an allocation request which does not perform memory zeroing (as the contents are going to be overwritten anyway).
> * second, it minimizes the overhead associated with reserving/unreserving memory. More specifically, it only calls Bits::reserveMemory/unreserveMemory when allocating from an automatic arena.
> 
> Implementation-wise, this is done by having an internal arena implementation class (`ArenaImpl`) which is the implementation returned by the various arena factories. This class will have methods to allocate zeroed memory and non-zeroed memory. In order to avoid duplication of the various allocation routines, I instead re-routed the SegmentAllocator methods to a private allocation implementation which sees if we're `ArenaImpl` and if so calls the implementation that has better knowledge. Alternatively I could have overridden all `allocateFrom` methods from `SegmentAllocator` but that would have required some duplication.
> 
> One caveat: a custom arena does NOT inherit this special behavior. That is, it is the responsibility of the custom arena to define "shortcut" for the `allocateFrom` methods. The only way to avoid that would be to have zeroing as an explicit boolean parameter in the allocation methods, but that's not very safe, as it is now up to client to decide if they want zeroing or not. That said, this is only an issue for custom arenas, and we can assume that a client that wants a specialized arena behavior can handle overriding a bunch of methods via delegation (in case they care).

This chart shows the improvements associated with this patch.

![allocateFrom](https://github.com/openjdk/panama-foreign/assets/54672762/7ab0bc2d-2856-49b5-bd7e-98ba8793b88d)

src/java.base/share/classes/java/lang/foreign/Arena.java line 270:

> 268:      */
> 269:     @Override
> 270:     MemorySegment allocate(long byteSize, long byteAlignment);

Note that this is no longer a default method. I don't think it should be. Custom arenas should override this to tell FFM how they want to allocate

-------------

PR Comment: https://git.openjdk.org/panama-foreign/pull/855#issuecomment-1660112775
PR Review Comment: https://git.openjdk.org/panama-foreign/pull/855#discussion_r1283404167