[fix] Make tokenizer test path robust, skip if model not found (#57) #59

Open
sleepy wants to merge 1 commit from fix/57-tokenizer-test-path into main
Owner

Summary

Fixes hardcoded tokenizer path in tests that fails on machines without Qwen3.5-4B model.

Changes

  • Check if tokenizer.json exists before running test
  • Skip test gracefully if model is not present
  • Test still runs and passes when model is available

Test Results

  • zig build test passes (154/156, 2 skipped when model absent)
## Summary Fixes hardcoded tokenizer path in tests that fails on machines without Qwen3.5-4B model. ## Changes - Check if tokenizer.json exists before running test - Skip test gracefully if model is not present - Test still runs and passes when model is available ## Test Results - `zig build test` passes (154/156, 2 skipped when model absent)
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin fix/57-tokenizer-test-path:fix/57-tokenizer-test-path
git switch fix/57-tokenizer-test-path

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main
git merge --no-ff fix/57-tokenizer-test-path
git switch fix/57-tokenizer-test-path
git rebase main
git switch main
git merge --ff-only fix/57-tokenizer-test-path
git switch fix/57-tokenizer-test-path
git rebase main
git switch main
git merge --no-ff fix/57-tokenizer-test-path
git switch main
git merge --squash fix/57-tokenizer-test-path
git switch main
git merge --ff-only fix/57-tokenizer-test-path
git switch main
git merge fix/57-tokenizer-test-path
git push origin main
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sleepy/sleepy-llm!59
No description provided.