RFR: 8364501: Compiler shutdown crashes on access to deleted CompileTask

[Manuel Hässig]

On Fri, 8 Aug 2025 12:30:36 GMT, Aleksey Shipilev <shade at openjdk.org> wrote:

> See the bug for more investigation. 
> 
> In short, with recent changes to `delete` `CompileTask`-s, we end up in the rare situation where we can access tasks that have been already deleted. The major and obivous mistake I committed myself with [JDK-8361752](https://bugs.openjdk.org/browse/JDK-8361752) in `CompileQueue::delete_all`: the code first `delete`-s, then asks for `next` (facepalms). 
> 
> Another case is less trivial, and mostly fix in abundance of caution: in `wait_for_completion`, we can exit while blocking task is still in queue. Current code skip deletions only when compiler is shutdown for compilation, but I think the condition should be stronger: unless the task is completed, we should assume it might carry the queue-ing `next`/`prev` pointers that `delete_all` would need, and skip deletion. Realistically, it would "leak" only on compiler shutdown, like before.
> 
> I have also put in some diagnostic code to catch the lifecycle issues like this more reliably, and cleaned up `next`, `prev` lifecycle to clearly disconnect the `CompileTasks` that are no longer in queue.
> 
> Additional testing:
>  - [x] Linux AArch64 server fastdebug, reproducer no longer fails
>  - [x] Linux AArch64 server fastdebug, `compiler`
>  - [ ] Linux AArch64 server fastdebug, `all`

Thank you for fixing this and adding the diagnostic code, @shipilev. The fix looks reasonable to me.
I kicked off testing on our side and will keep you posted on the results.

-------------

PR Review: https://git.openjdk.org/jdk/pull/26696#pullrequestreview-3101141141