llama-bench: add -fitc and -fitt to arguments (#21304)

* llama-bench: add `-fitc` and `-fitt` to arguments * update README.md * address review comments * update compare-llama-bench.py
2026-04-06 22:26:02 +08:00
parent 4aa962e2b0
commit 94ca829b60
3 changed files with 107 additions and 6 deletions
@@ -62,6 +62,8 @@ test parameters:
  -ot --override-tensors <tensor name pattern>=<buffer type>;...
                                            (default: disabled)
  -nopo, --no-op-offload <0|1>              (default: 0)
+  -fitt, --fit-target <MiB>                 fit model to device memory with this margin per device in MiB (default: off)
+  -fitc, --fit-ctx <n>                      minimum ctx size for --fit-target (default: 4096)

 Multiple values can be given for each parameter by separating them with ','
 or by specifying the parameter multiple times. Ranges can be given as