furyhawk/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-07-21 10:15:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

llama-quantize: --dry-run option (#1309)

Browse Source
This commit is contained in:
Kawrakow
2026-02-24 15:21:52 +01:00
committed by GitHub
parent 96b8298472
commit cfb6747776
4 changed files with 64 additions and 49 deletions
Download Patch File Download Diff File Expand all files Collapse all files
include/llama.h
+1
View File
@@ -490,6 +490,7 @@ extern "C" {
bool keep_split; // quantize to the same number of shards
bool ignore_imatrix_rules; // If set to true, the built-in rules for refusing to quantize into certain quants without imatrix are ignored
bool only_repack; // Only repack tensors
bool dry_run; //
void * imatrix; // pointer to importance matrix data
void * kv_overrides; // pointer to vector containing overrides
void * custom_quants; // pointer to vector containing custom quantization rules