sleepy/llama.cpp
1
0
Fork 0
Code Issues 16 Pull Requests Actions 69 Packages Projects Releases Wiki Activity

Fix Kimi-K2 tool-call parsing issues (#17376)

Browse Source 
* Fix kimi-k2 parsing

* fix template & add more tests for kimi-k2

* Another fix for Kimi-K2 chat template.

* enable allow_toolcall_in_think for Kimi-K2

* Refine key-value separator and value end format

* Enable tool call in think for kimi-k2

* allow_toolcall_in_think is now tested with Kimi-K2

* Remove outdated TODO comment in XML tool call parser

Removed TODO comment about untested tool call feature.

* Rename function from "utf8_truncate_safe" to "utf8_truncate_safe_len"
This commit is contained in:
hksdpc255
2025-12-09 00:32:04 +11:00
committed by GitHub
parent 51e0c2d917
commit 636fc17a37
6 changed files with 194 additions and 50 deletions
Download Patch File Download Diff File Expand all files Collapse all files
common/chat-parser.cpp
+3 -2
View File
@@ -917,12 +917,13 @@ static void common_chat_parse_kimi_k2(common_chat_msg_parser & builder) {
form.tool_start = "<|tool_call_begin|>";
form.tool_sep = "<|tool_call_argument_begin|>{";
form.key_start = "\"";
form.key_val_sep = "\": ";
form.val_end = ", ";
form.key_val_sep = "\":";
form.val_end = ",";
form.tool_end = "}<|tool_call_end|>";
form.scope_end = "<|tool_calls_section_end|>";
form.raw_argval = false;
form.last_val_end = "";
form.allow_toolcall_in_think = true;
return form;
})();
builder.consume_reasoning_with_xml_tool_calls(form, "<think>", "</think>");