Xuan-Son Nguyen 9e39a1e6a9 server: support load model on startup, support preset-only options (#18206) ...

* server: support autoload model, support preset-only options

* add docs

* load-on-startup

* fix

* Update common/arg.cpp

Co-authored-by: Pascal <admin@serveurperso.com>

---------

Co-authored-by: Pascal <admin@serveurperso.com>

2025-12-20 09:25:27 +01:00

..

batched-bench

batched-bench : add "separate text gen" mode (#17103)

2025-11-10 12:59:29 +02:00

cli

cli: fixed dead links to tools/main for cli and completion, fixed code owners (#17993)

2025-12-15 11:47:04 +01:00

completion

arg: clarify auto kvu/np being set on server (#17997)

2025-12-16 12:01:27 +01:00

cvector-generator

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

export-lora

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

fit-params

llama-fit-params: QoL impr. for prints/errors (#18089)

2025-12-17 00:03:19 +01:00

gguf-split

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

imatrix

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

llama-bench

cli: fixed dead links to tools/main for cli and completion, fixed code owners (#17993)

2025-12-15 11:47:04 +01:00

mtmd

model : add ASR support for LFM2-Audio-1.5B (conformer) (#18106)

2025-12-19 00:18:01 +01:00

perplexity

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

quantize

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

rpc

Install rpc-server when GGML_RPC is ON. (#17149)

2025-11-11 10:53:59 +00:00

run

Manually link -lbsd to resolve flock symbol on AIX (#16610)

2025-10-23 19:37:31 +08:00

server

server: support load model on startup, support preset-only options (#18206)

2025-12-20 09:25:27 +01:00

tokenize

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

tts

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

CMakeLists.txt

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00