Xuan-Son Nguyen 9ac2693a30 server: fix n_cmpl not skipping processing prompt (#18663) ...

* server: fix n_cmpl not skipping processing

* fix infinite loop on empty batch

* cont : init child samplers + modify child logic

* cont : cleanup

* cont : improve n_cmpl logic

- launch the parent task first so it finds the slot with best cache
- parent task waits for child tasks to be launched
- when a child task finishes - remove its cache

* cont : remove redundant function

* cont : reduce parent checks

* fix : nullptr task dereference

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2026-01-10 00:00:41 +01:00

..

batched-bench

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

cli

gen-docs: automatically update markdown file (#18294)

2025-12-22 19:30:19 +01:00

completion

common: fix return value check for setpriority (#18412)

2025-12-29 11:07:49 +02:00

cvector-generator

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

export-lora

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

fit-params

llama-fit-params: free memory target per device (#18679)

2026-01-08 10:07:58 +01:00

gguf-split

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

imatrix

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

llama-bench

common: fix return value check for setpriority (#18412)

2025-12-29 11:07:49 +02:00

mtmd

mtmd: Add Gemma3n multimodal support with MobileNetV5 vision encoder (#18256)

2026-01-09 23:42:38 +01:00

perplexity

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

quantize

quantize: prevent input/output file collision (#18451)

2025-12-31 23:29:03 +08:00

rpc

Install rpc-server when GGML_RPC is ON. (#17149)

2025-11-11 10:53:59 +00:00

server

server: fix n_cmpl not skipping processing prompt (#18663)

2026-01-10 00:00:41 +01:00

tokenize

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

tts

common : refactor common_sampler + grammar logic changes (#17937)

2025-12-14 10:11:13 +02:00

CMakeLists.txt

cmake: only build cli when server is enabled (#18670)

2026-01-09 16:43:26 +01:00