mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-07-21 10:15:53 +00:00
Georgi Gerganov
3203ab47a6
In router mode with models_max, unload_lru() could select a model in LOADING state as the LRU victim. Because the child's stdin monitoring thread starts only after model loading completes, the exit command sits unread in the buffer and the stop_timeout expires before the child ever receives it, causing a force-kill. LOADING models still count toward capacity to prevent resource exhaustion from concurrent loads, but are excluded from eviction.