sleepy/llama.cpp
1
0
Fork 0
Code Issues 8 Pull Requests 1 Actions 98 Packages Projects Releases Wiki Activity

Eliminate zero-ops (VIEW/RESHAPE/TRANSPOSE/PERMUTE) #27

New Issue
Closed
opened 2026-04-30 18:11:33 +02:00 by sleepy · 0 comments
sleepy commented 2026-04-30 18:11:33 +02:00
Owner
Copy Link
Copy Source

No code change needed. Zero-ops (VIEW/RESHAPE/TRANSPOSE/PERMUTE) are already filtered at ggml-metal-ops.cpp:59 before encoding — they return 1 and skip to next node without GPU dispatch. The 682 zero-ops/tick incur zero dispatch overhead.

No code change needed. Zero-ops (VIEW/RESHAPE/TRANSPOSE/PERMUTE) are already filtered at ggml-metal-ops.cpp:59 before encoding — they return 1 and skip to next node without GPU dispatch. The 682 zero-ops/tick incur zero dispatch overhead.
sleepy added the perf label 2026-04-30 18:11:33 +02:00
sleepy changed title from Eliminate zero-ops VIEW RESHAPE TRANSPOSE PERMUTE to Eliminate zero-ops (VIEW/RESHAPE/TRANSPOSE/PERMUTE) 2026-04-30 18:16:37 +02:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
doc
feature
infra
kernel
perf
profiling
No Label perf
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
sleepy
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sleepy/llama.cpp#27
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?