sleepy/llama.cpp
1
0
Fork 0
Code Issues 8 Pull Requests 1 Actions 98 Packages Projects Releases Wiki Activity

IQ4_XS tg4096 anomaly (45 vs 76 tok/s on 4B) #33

New Issue
Closed
opened 2026-04-30 18:11:36 +02:00 by sleepy · 0 comments
sleepy commented 2026-04-30 18:11:36 +02:00
Owner
Copy Link
Copy Source

Not reproducible. IQ4_XS now performs on par with Q4_0 (53.25 vs 52.05 tok/s at tg4096 on 9B). Original anomaly was likely due to Metal driver state, GPU caching, or thermal conditions.

Not reproducible. IQ4_XS now performs on par with Q4_0 (53.25 vs 52.05 tok/s at tg4096 on 9B). Original anomaly was likely due to Metal driver state, GPU caching, or thermal conditions.
sleepy added the bug label 2026-04-30 18:11:36 +02:00
sleepy changed title from IQ4_XS tg4096 anomaly - 45 vs 76 tok per s on 4B to IQ4_XS tg4096 anomaly (45 vs 76 tok/s on 4B) 2026-04-30 18:16:38 +02:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
doc
feature
infra
kernel
perf
profiling
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
sleepy
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sleepy/llama.cpp#33
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?