Intel AMX and feature detection

[Radosław Smogura]

Hi all

I think having support for AI instructions would be very good idea from marketing point of view, as it would allow to embed some AI models into backend applications.

This way Java would be able to support generative AI LLM models and ultimately keep up to speed with current trends in computer science.

(A bit marketing stance than technical)

BR,
Rado

> On 17 Jun 2024, at 06:27, Andrii Lomakin <andrii0lomakin at gmail.com> wrote:
> 
> Hi guys.
> 
> I have three  questions:
> 
> 1.   Do you plan to add support for Intel AMX instructions? According
> to Intel reports, it can add 2-3 times speedup in deep learning model
> inference.
> 2. The next question follows from the first one. Even now, masks are
> not supported in every architecture, but AFAIK, there is no way to
> detect whether they are supported at runtime. Do you plan to provide a
> so-called "feature detection" API?
> 3. And the last question: even on older sets of commands, there are
> some that use register values as masks, blending, for example. Will
> those instructions be supported on architectures that do not support
> masking registers per se?