furyhawk/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-07-21 10:15:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,735 Commits 952 Branches 1 Tag
main
Commit Graph
3 Commits
Author SHA1 Message Date
Samuel Oliveira AlvesandGitHub 3c6cbf6e2a feat: allow dflash to work with spec auto tune (#2112) 2026-07-12 07:49:03 +03:00
Samuel Oliveira AlvesandGitHub be8435793e Pre-allocate buffers for hybrid model checkpoints (#1774) 
* hybrid-spec: improve recurrent checkpoint handling in speculative decoding

* change per-step save to support scheduling and asynchronous tensor operations

* remove redudant backend tensor fallback

* improve recurrent tensor handling for split graph
 2026-05-12 07:21:25 +03:00
Samuel Oliveira AlvesandGitHub 3de81530c5 Allow tuning of the best args for speculative decoding. (#1595) 
* wip: build spec tuner for spefic args

* wip: test different reward system

* spec-tune: fix the reward to find best params given a good TPS

* spec-tune: refactor logic for its own file

* minor clean for comments and modules
 2026-04-08 08:02:42 +02:00