Back to feed

b9084

May 9, 2026
Meta/llama.cppCLIvb9084

hexagon: add HTP kernel for GGML_OP_GATED_DELTA_NET (#22837)

Implement the Gated Delta Net recurrence on HVX with:

  • 4-row fused kernels for PP (prompt processing) path
  • 8-row fused kernels for TG (token generation) path, reducing K/Q/gate vector reload overhead by 2x
  • Separate PP/TG thread functions for I-cache isolation
  • VTCM state scratchpad with DMA in/out for TG single-cycle access
  • Vectorized gate exp via hvx_exp_f32

macOS/iOS:

Linux:

Android:

Windows:

openEuler: