jax-flash-attn2:一个为JAX设计的灵活高效的Flash Attention 2.0实现,支持GPU/TPU/CPU多后端和Triton/Pallas/JAX多平台
- 爱可可-爱生活
- 2024-10-27 12:33:35
【jax-flash-attn2:一个为JAX设计的灵活高效的Flash Attention 2.0实现,支持GPU/TPU/CPU多后端和Triton/Pallas/JAX多平台】'jax-flash-attn2 - A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).' GitHub: github.com/erfanzar/jax-flash-attn2 FlashAttention JAX GPUSupport