Back to feed

b8089

Feb 18, 2026
Meta/llama.cppCLIvb8089

vulkan: split mul_mat into multiple dispatches to avoid overflow (#19509)

  • vulkan: split mul_mat into multiple dispatches to avoid overflow

The batch dimensions can be greater than the max workgroup count limit, in which case we need to split into multiple dispatches and pass the base index through a push constant.

Fall back for the less common p021 and nc variants.

  • address feedback

macOS/iOS:

Linux:

Windows:

openEuler: