Pasha Khosravi and GitHub
14d3ba45f3
metal : add Q2_0 support ( #25419 )
2026-07-14 07:52:00 +03:00
Pasha Khosravi and GitHub
bec4772f6a
Add Q2_0 quantization: type definition and CPU backend ( #24448 )
2026-07-07 12:05:47 -07:00
7e72b38bc1
cuda: Q1_0 initial backend ( #21629 )
...
* [cuda] initial Q1_0 backend
* remove unused code, fix AMD MMA guard
* attempt to support dp4a
* Apply suggestions from code review
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2026-04-15 18:38:38 +02:00
dcdcbad42a
metal: Q1_0 backend ( #21528 )
...
* initial Q1_0 Metal backend
* tuning q1_0 metal kernels
* add Q1_0 to test-backend-ops
* add Q1_0<->F32 copy test
* Apply suggestions from code review
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2026-04-08 16:07:47 +03:00
2e1f0a889e
ggml: add Q1_0 1-bit quantization support (CPU) ( #21273 )
...
* ggml: add Q1_0 and Q1_0_g128 1-bit quantization support (CPU)
* add generic fallback for x86
* remove Q1_0 (group size 32)
* rename Q1_0_g128 => Q1_0
* fix Q1_0 LlamaFileType Enum
* Fix trailing spaces; add generic fallback for othre backends
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* fix /r/n spacing + arch-fallback
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2026-04-06 20:55:21 +02:00
