b8578

hexagon: dma optimizations (mostly fixing regressions) (#21137)

• hex-fa: add simple dma cache for Mask

I noticed that we were refetch the mask rows over and over. This simple cache avoids that.

• hex-dma: unset in-order desc bit which caused signficant perf regression

We don't rely on true in order processing of the DMA descriptors anywhere. Turns out this mode caused significant regression of around 3-4 TPS during token gen.

• hex-rope: update comment to clarify that we don't need in-order DMA completions

macOS/iOS:

• macOS Apple Silicon (arm64)
• macOS Intel (x64)
• iOS XCFramework

Linux:

• Ubuntu x64 (CPU)
• Ubuntu x64 (Vulkan)
• Ubuntu x64 (ROCm 7.2)
• Ubuntu s390x (CPU)
• Ubuntu x64 (OpenVINO)

Windows:

• Windows x64 (CPU)
• Windows arm64 (CPU)
• Windows x64 (CUDA 12) - CUDA 12.4 DLLs
• Windows x64 (CUDA 13) - CUDA 13.1 DLLs
• Windows x64 (Vulkan)
• Windows x64 (SYCL)
• Windows x64 (HIP)

openEuler:

• openEuler x86 (310p)
• openEuler x86 (910b, ACL Graph)
• openEuler aarch64 (310p)
• openEuler aarch64 (910b, ACL Graph)