furyhawk/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-07-21 10:15:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ik/indexer_top_cuda
ik_llama.cpp/include
T
History
KawrakowandGitHub 6d30fa2fe6 Fused indexer top_k (CPU only) (#2098) 
* Indexer topk op - CPU only

We do save memory, but it is somehow much slower than what we have on
main.

* Make it a command line option
2026-07-09 18:04:41 +03:00
..
llama.h
Fused indexer top_k (CPU only) (#2098)
2026-07-09 18:04:41 +03:00