sleepy/llama.cpp
1
0
Fork 0
Code Issues 11 Pull Requests Actions 114 Packages Projects Releases Wiki Activity

server: (router) add stop-timeout option (#18350)

Browse Source 
* server: (router) add stop-timeout option

* also allow stop while loading

* add docs

* unload_lru: also wait for unload to complete
This commit is contained in:
Xuan-Son Nguyen
2025-12-24 23:47:49 +01:00
committed by GitHub
parent 4cbafad4f0
commit f5acfb2ffa
5 changed files with 133 additions and 64 deletions
Download Patch File Download Diff File Expand all files Collapse all files
common/arg.h
+1
View File
@@ -10,6 +10,7 @@
// pseudo-env variable to identify preset-only arguments
#define COMMON_ARG_PRESET_LOAD_ON_STARTUP "__PRESET_LOAD_ON_STARTUP"
#define COMMON_ARG_PRESET_STOP_TIMEOUT "__PRESET_STOP_TIMEOUT"
//
// CLI argument parsing