Sascha Rogmann 455d8e4be8 server : speculative checkpointing (#19493) ...

* server : speculative decoding using checkpoints

* server : fix draft check with checkpoints

* server : rename spec vars

* server : log levels

* server : refactored spec logic to speculative.cpp

* server : renamed spec checkpoints option

* server : fix spec checkpoints, logging

* speculative : checkpoints with draft model, logging

* server : n_tokens_cur and create_checkpoint in draft

* server : fix server_speculative_callback (slot.id)

* spec : fix ngram-map/begin idx_last_check

* spec : init ckpt (begin() wasn't called)

* chore: update webui build output

* server : restore sampler in spec checkpoint and clear mem

* cont : avoid --spec-use-checkpoints argument

* cont : remove server_prompt_checkpoint_with_size

* spec : rename (leave_draft_state)

* cont : clean-up

* cont : do not ignore partial drafts even if the are short

* cont : spec callback owned by session

* cont : simplify

* cont : avoid empty speculative session

* cont : simplify

* cont : simplify

* cont : enable mtmd speculative decoding

* cont : keep the spec sampler alive

* cont : simplify

* cont : fix nullptr deref + draft checkpoints

* cont : remove common_speculative_accept_response

* cont : remove callback

* cont : simplify

* cont : minor

* cont : simplify

* cont : fix accepted number

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2026-04-19 10:24:06 +03:00

..

jinja

jinja : support ensure_ascii=true, string repetition and int/float self-filtering (#21623)

2026-04-09 11:28:33 +02:00

arg.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

arg.h

vendor : update cpp-httplib to 0.30.0 (#18660)

2026-01-08 13:53:54 +01:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

build-info.h

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

chat-auto-parser-generator.cpp

autoparser: support case of JSON_NATIVE with per-call markers (test case: Reka-Edge) (#21892)

2026-04-15 10:51:50 +02:00

chat-auto-parser-helpers.cpp

common : replace wrap_for_generation with a prefix convenience function and fix gpt-oss (#20912)

2026-03-23 22:21:47 -05:00

chat-auto-parser-helpers.h

chat : avoid including json in chat.h (#21306)

2026-04-03 09:07:59 +03:00

chat-auto-parser.h

autoparser: support case of JSON_NATIVE with per-call markers (test case: Reka-Edge) (#21892)

2026-04-15 10:51:50 +02:00

chat-diff-analyzer.cpp

autoparser: support case of JSON_NATIVE with per-call markers (test case: Reka-Edge) (#21892)

2026-04-15 10:51:50 +02:00

chat-peg-parser.cpp

autoparser: support case of JSON_NATIVE with per-call markers (test case: Reka-Edge) (#21892)

2026-04-15 10:51:50 +02:00

chat-peg-parser.h

common : add gemma 4 specialized parser (#21418)

2026-04-04 20:39:00 +02:00

chat.cpp

server : speculative checkpointing (#19493)

2026-04-19 10:24:06 +03:00

chat.h

common : add gemma 4 specialized parser (#21418)

2026-04-04 20:39:00 +02:00

CMakeLists.txt

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

common.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

common.h

server : speculative checkpointing (#19493)

2026-04-19 10:24:06 +03:00

console.cpp

cli: fix stripping of \n in multiline input (#21485)

2026-04-06 20:54:06 +02:00

console.h

cli : add command and file auto-completion (#19985)

2026-03-05 10:47:28 +01:00

debug.cpp

debug: make common_debug_print_tensor readable (#19331)

2026-02-04 17:55:31 +01:00

debug.h

chore : correct typos [no ci] (#20041)

2026-03-05 08:50:21 +01:00

download.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

download.h

common : add download cancellation and temp file cleanup (#21813)

2026-04-13 11:18:23 +02:00

hf-cache.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

hf-cache.h

common : fix split model migration (#21019)

2026-03-26 12:04:37 +01:00

http.h

server: Parse port numbers from MCP server URLs in CORS proxy (#20208)

2026-03-09 17:47:54 +01:00

json-partial.cpp

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

2025-11-18 18:54:15 +01:00

json-partial.h

cli : fix reasoning responses in CLI (#18961)

2026-01-20 18:23:25 +01:00

json-schema-to-grammar.cpp

common/json-schema: fix: handle non-capturing groups (?:...) in JSON schema pattern converter (#21124)

2026-03-28 17:55:38 +01:00

json-schema-to-grammar.h

common : add nemotron 3 parsing (#18077)

2025-12-16 04:05:23 -06:00

llguidance.cpp

sampling : add support for backend sampling (#17004)

2026-01-04 22:22:16 +02:00

log.cpp

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

log.h

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

ngram-cache.cpp

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-cache.h

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-map.cpp

server : speculative checkpointing (#19493)

2026-04-19 10:24:06 +03:00

ngram-map.h

fix: correct misspellings in code comments (#21217)

2026-03-31 13:50:51 +02:00

ngram-mod.cpp

spec : add ngram-mod (#19164)

2026-01-30 18:21:48 +02:00

ngram-mod.h

ngram-mod : fix build [no ci] (#19216)

2026-01-30 21:27:27 +02:00

peg-parser.cpp

common/gemma4 : handle parsing edge cases (#21760)

2026-04-13 18:18:18 -05:00

peg-parser.h

common/gemma4 : handle parsing edge cases (#21760)

2026-04-13 18:18:18 -05:00

preset.cpp

preset: allow named remote preset (#18728)

2026-01-10 15:12:29 +01:00

preset.h

common: support remote preset (#18520)

2026-01-08 22:35:40 +01:00

reasoning-budget.cpp

common : inhibit lazy grammar sampler while reasoning is active (#20970)

2026-03-27 18:30:40 +01:00

reasoning-budget.h

common : inhibit lazy grammar sampler while reasoning is active (#20970)

2026-03-27 18:30:40 +01:00

regex-partial.cpp

common : fix iterator::end() dereference (#20445)

2026-03-16 08:50:38 +02:00

regex-partial.h

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

sampling.cpp

common: skip reasoning budget sampler when no budget is requested (#21870)

2026-04-14 12:43:06 +02:00

sampling.h

sampling : add support for backend sampling (#17004)

2026-01-04 22:22:16 +02:00

speculative.cpp

server : speculative checkpointing (#19493)

2026-04-19 10:24:06 +03:00

speculative.h

server : speculative checkpointing (#19493)

2026-04-19 10:24:06 +03:00

unicode.cpp

common/parser: handle reasoning budget (#20297)

2026-03-11 10:26:12 +01:00

unicode.h

common/parser: handle reasoning budget (#20297)

2026-03-11 10:26:12 +01:00