cleanup: Remove profiling prints before merge #44

Closed
opened 2026-05-15 19:02:26 +02:00 by sleepy · 1 comment
Owner

The decode timing instrumentation in engine.zig and model.zig should be removed or made conditional before merging to master:

  • engine.zig: "Decode: X tokens in Ys = Z tok/s" — keep this one (useful for CLI)
  • model.zig: "decode_profile: gpu=Xms readback+argmax=Yms" — remove or gate behind debug flag
  • Both use std.c.mach_absolute_time() and std.c.mach_timebase_info which are macOS-specific
The decode timing instrumentation in engine.zig and model.zig should be removed or made conditional before merging to master: - `engine.zig`: "Decode: X tokens in Ys = Z tok/s" — keep this one (useful for CLI) - `model.zig`: "decode_profile: gpu=Xms readback+argmax=Yms" — remove or gate behind debug flag - Both use `std.c.mach_absolute_time()` and `std.c.mach_timebase_info` which are macOS-specific
Author
Owner

Merged via squash. Profiling prints gated behind @import("builtin").mode == .Debug.

  • decode_profile and argmax_compare prints only appear in debug builds
  • GPU argmax dispatch moved inside debug block (no dead work in release)
  • Shared readback and CPU argmax logic kept single-path
  • CLI decode timing in engine.zig preserved
Merged via squash. Profiling prints gated behind `@import("builtin").mode == .Debug`. - `decode_profile` and `argmax_compare` prints only appear in debug builds - GPU argmax dispatch moved inside debug block (no dead work in release) - Shared readback and CPU argmax logic kept single-path - CLI decode timing in engine.zig preserved
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sleepy/sleepy-llm#44
No description provided.