Jeff Bolz 61bde8e21f vulkan: Reduce temporary memory usage for TOP_K (#17623) ...

- Compute row size for the temp buffer based on the output of the first pass.
- Update shader addressing math to use the output row size
- Pass the output row size as "ncols_output", what used to be "ncols_output" is now "k"

For the common case of K=40 and src0=(200000,1,1,1), this reduces the temporary buffer
from about 3.2MB to 500KB.

2025-12-02 19:22:04 +01:00

..

ggml-blas

sync : whisper.cpp (ggml/1359)

2025-09-29 17:43:58 +03:00

ggml-cann

CANN: Disable Ger operator of OUT_PROD on 310p device (#17563)

2025-12-02 20:35:23 +08:00

ggml-cpu

ggml : use svcntb() for SVE vector length detection (#17474)

2025-12-02 18:21:11 +02:00

ggml-cuda

ggml-cuda: reorder only relevant nodes (#17639)

2025-12-02 12:36:31 +08:00

ggml-hexagon

hexagon: add support for ROPE_NEOX (#17458)

2025-11-23 18:55:56 -08:00

ggml-hip

HIP: fix AMDGPU_TARGETS, update documentation (#16803)

2025-10-27 21:39:49 +01:00

ggml-metal

metal : add FA head size 48 (#17619)

2025-12-01 12:49:53 +02:00

ggml-musa

CUDA: faster tile FA, add oob checks, more HSs (#16492)

2025-10-11 20:54:32 +02:00

ggml-opencl

model: LFM2-VL fixes (#17577)

2025-11-30 21:57:31 +01:00

ggml-rpc

rpc : cache and reuse compute graphs (#15405)

2025-11-28 08:33:51 +00:00

ggml-sycl

enhance argsort for UT (#17573)

2025-12-02 08:56:46 +08:00

ggml-vulkan

vulkan: Reduce temporary memory usage for TOP_K (#17623)

2025-12-02 19:22:04 +01:00

ggml-webgpu

ggml webgpu: faster matrix multiplication/matrix-vector multiplication (#17031)

2025-11-07 19:27:20 -08:00

ggml-zdnn

zdnn: refactor codebase + add docs (#16178)

2025-09-23 14:53:05 +08:00

CMakeLists.txt

ggml: fix: macOS build with -DGGML_BACKEND_DL=ON (#17581)

2025-11-30 10:00:59 +08:00

ggml-alloc.c

ggml : add GGML_SCHED_NO_REALLOC option to disable reallocations in ggml_backend_sched (#17276)

2025-11-28 17:33:23 +02:00

ggml-backend-impl.h

rpc : add support for multiple devices (#16276)

2025-10-04 12:49:16 +03:00

ggml-backend-reg.cpp

Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)

2025-10-22 13:47:09 -07:00

ggml-backend.cpp

ggml : remove redundant n_copies check when setting input/output (#17612)

2025-12-02 12:52:45 +01:00

ggml-common.h

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

ggml-impl.h

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

2025-11-13 20:54:47 +02:00

ggml-opt.cpp

finetune: SGD optimizer, more CLI args (#13873)

2025-08-14 12:03:57 +02:00

ggml-quants.c

ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (#15928)

2025-09-23 10:25:20 +02:00

ggml-quants.h

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

model: LFM2-VL fixes (#17577)

2025-11-30 21:57:31 +01:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

gguf: gguf_writer refactor (#15691)

2025-09-05 11:34:28 +02:00