Intel AMX and feature detection
Andrii Lomakin
andrii0lomakin at gmail.com
Mon Jun 17 04:26:10 UTC 2024
Hi guys.
I have three questions:
1. Do you plan to add support for Intel AMX instructions? According
to Intel reports, it can add 2-3 times speedup in deep learning model
inference.
2. The next question follows from the first one. Even now, masks are
not supported in every architecture, but AFAIK, there is no way to
detect whether they are supported at runtime. Do you plan to provide a
so-called "feature detection" API?
3. And the last question: even on older sets of commands, there are
some that use register values as masks, blending, for example. Will
those instructions be supported on architectures that do not support
masking registers per se?
More information about the panama-dev
mailing list