ZYFA: AMD MI355X Dedicated FP8 FlashAttention Released
The story so far
Zyphra has released ZYFA (Zyphra FlashAttention on AMD), targeting FP8 and BF16 pre-filled attention kernels for the AMD Instinct MI355X GPU. Its FP8 kernel is 1.16-1.76 times faster than AMD's default kernel library AITER in real model activation, and has 62-78% lower FP8 error under 128-dimensional heads compared to AITER.
AI-written from the reports · Updated 12 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- MarkTechPostZyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster
Zyphra has released ZYFA (Zyphra FlashAttention on AMD), a set of FP8 and BF16 pre-filled attention kernels optimized for the AMD Instinct MI355X GPU. On real model activations, its FP8 kernel is 1.16-1.76x faster than AMD's default AITER kernel library, and the FP8 error is 62-78% lower than AITER under 128-dimensional heads.