b8003
model: Add Kimi-K2.5 support (#19170)
Move dequant_model to after the text_config merge Add new kimi-k2.5 keys to mtmd convert Update V_MMPROJ tensor mapping for new mm_projector.proj keys Update V_M_IMP_NORM for new mm_projector.pre_norm key
Fix a couple of oversights
Add image support for Kimi-K2.5
Revert changes to KimiVLForConditionalGeneration
Fix an assert crash
Fix permute swapping w / h on accident
Kimi-K2.5: Use merged QKV for vision
Kimi-K2.5: pre-convert vision QK to use build_rope_2d
Kimi-K2.5: support non-interleaved rope for vision
Kimi-K2.5: fix min / max pixel
Kimi-K2.5: remove v/o permutes, unnecessary
Kimi-K2.5: update permute name to match
Update convert_hf_to_gguf.py
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
- Kimi-K2.5: replace build_rope_2d ggml_cont with ggml_view_3d pointers
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: