b8682
ggml: add Q1_0 1-bit quantization support (CPU) (#21273)
ggml: add Q1_0 and Q1_0_g128 1-bit quantization support (CPU)
add generic fallback for x86
remove Q1_0 (group size 32)
rename Q1_0_g128 => Q1_0
fix Q1_0 LlamaFileType Enum
Fix trailing spaces; add generic fallback for othre backends
Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
- fix /r/n spacing + arch-fallback
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
macOS/iOS:
Linux:
- Ubuntu x64 (CPU)
- Ubuntu arm64 (CPU)
- Ubuntu s390x (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu arm64 (Vulkan)
- Ubuntu x64 (ROCm 7.2)
- Ubuntu x64 (OpenVINO)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: