furyhawk/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-21 10:15:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,075 Commits 618 Branches 6,870 Tags
master
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yash Raj PandeyandGitHub 4937ca83f4 llama-quant : exclude i32 ffn_gate_tid2eid routing table from quantization (#25787) 
DeepSeek-V4's ffn_gate_tid2eid tensor is an i32 token-id -> expert-id
index table, not weights. It was never added to the name-based
exclusion list alongside ffn_gate_inp.weight, so llama-quantize tries
to quantize it and fails since i32 cannot convert to a float type.

Fixes ggml-org/llama.cpp#25754

Signed-off-by: Yash Raj Pandey <yashpn62@gmail.com>
 2026-07-18 13:43:18 +02:00
Yash Raj PandeyGitHubGeorgi Gerganov
 		fd3271e0b4 ggml-cpu : fix rms_norm_back wrong output under in-place aliasing (#24305) 
* ggml-cpu : fix rms_norm_back wrong output under in-place aliasing

* cont : clean-up comment

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2026-06-09 10:24:27 +03:00