RoLA

Rotary-positioned low-rank linear attention for efficient Diffusion Transformers.

RoLA introduces a rotary-positioned low-rank linear attention branch for efficient Diffusion Transformers.