Intel AMX and feature detection

Andrii Lomakin andrii0lomakin at gmail.com
Mon Jun 17 04:26:10 UTC 2024


Hi guys.

I have three  questions:

1.   Do you plan to add support for Intel AMX instructions? According
to Intel reports, it can add 2-3 times speedup in deep learning model
inference.
2. The next question follows from the first one. Even now, masks are
not supported in every architecture, but AFAIK, there is no way to
detect whether they are supported at runtime. Do you plan to provide a
so-called "feature detection" API?
3. And the last question: even on older sets of commands, there are
some that use register values as masks, blending, for example. Will
those instructions be supported on architectures that do not support
masking registers per se?


More information about the panama-dev mailing list