Skip to content
Live
Trending storyPast story

ZYFA: AMD MI355X Dedicated FP8 FlashAttention Released

1 reports1 outlets12 days agoUpdate

The story so far

AI overview

Zyphra has released ZYFA (Zyphra FlashAttention on AMD), targeting FP8 and BF16 pre-filled attention kernels for the AMD Instinct MI355X GPU. Its FP8 kernel is 1.16-1.76 times faster than AMD's default kernel library AITER in real model activation, and has 62-78% lower FP8 error under 128-dimensional heads compared to AITER.

AI-written from the reports · Updated 12 days ago

Coverage timeline

Follow the coverage to see every side of the story.

7 Nov
  1. MarkTechPost
    Zyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster

    Zyphra has released ZYFA (Zyphra FlashAttention on AMD), a set of FP8 and BF16 pre-filled attention kernels optimized for the AMD Instinct MI355X GPU. On real model activations, its FP8 kernel is 1.16-1.76x faster than AMD's default AITER kernel library, and the FP8 error is 62-78% lower than AITER under 128-dimensional heads.