[memory] Deduplicate tokenization and similarity logic across 5 modules #869

Closed
sleepy wants to merge 0 commits from fix/dedup-tokenization-748 into dev
Owner
No description provided.
Issue #748: The last remaining duplicate tokenization implementation in
src/personal_docs.py has been replaced with a delegation to the canonical
services.memory.text_utils.tokenize.

The other 3 modules (memory.py, skills.py, memory_extractor.py) already
imported from text_utils. src/memory.py no longer exists.

Changes:
- src/personal_docs.py:tokenize() now delegates to services.memory.text_utils
- Removed unused STOP_WORDS from PersonalDocsConfig
- Removed unused 'import re'
sleepy closed this pull request 2026-06-03 23:56:50 +02:00

Pull request closed

Sign in to join this conversation.
No description provided.