Files
llama.cpp/tools
Georgi GerganovandGitHub bf2c86ddc0 server : refactor prompt cache state ownership (#25649)
* server : clear checkpoints upon prompt clear

* server : move the prompt state data to the server_prompt_cache

Assisted-by: pi:llama.cpp/Qwen3.6-27B

* server : handle batched slot being cleared
2026-07-14 18:25:52 +03:00
..
2026-06-25 02:49:22 +02:00
2026-05-14 13:05:52 +03:00