Back to feed

b9574

Jun 9, 2026
Meta/llama.cppCLIvb9574

server : do not clear slots without unified KV cache (#24190)

  • Always export idle slots to RAM

Without this, a slot's VRAM cache may not be written to RAM. If this slot happens to be busy then later on, this triggers needless preprocessing in another slot.

  • cont : clean-up

Co-authored-by: Christoph Weiss weiss@wsoptics.de Co-authored-by: Georgi Gerganov ggerganov@gmail.com

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: