furyhawk/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-07-21 18:25:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f4125e8b1f1de07ac07fbcdcca34d3a8f89f65e2
ik_llama.cpp/include
T
History
KawrakowandGitHub b7a2bde4cc Take into account layer sizes for setting GPU layers (cont) (#1476) 
* Also take into account KV cache

* Take into account attn_wkv_b and mla = 3 compute buffers
2026-03-23 17:46:53 +01:00
..
llama.h
Take into account layer sizes for setting GPU layers (cont) (#1476)
2026-03-23 17:46:53 +01:00