sleepy/odysseus
1
0
Fork
You've already forked odysseus
 0
Code Issues 9 Pull requests 10 Projects Releases Packages Wiki Activity Actions

[llm] Thread-safe mutable globals in llm_core (#709) #832

Closed
sleepy wants to merge 0 commits from fix/llm-core-thread-safety-709 into main
pull from: fix/llm-core-thread-safety-709
merge into: sleepy:main
Conversation 0 Commits - Files changed -
sleepy commented 2026-06-03 19:58:12 +02:00
Owner
Copy link

Fixes #709

Fixes #709
Add threading.Lock synchronization to all module-level mutable globals
in llm_core.py to prevent data races under concurrent async requests:

- _TTLCache: internal lock on get/set/clear/__len__/_purge_expired
- _dead_hosts, _host_fails, _model_activity: shared _state_lock
- _http_client: dedicated _http_client_lock for lazy init

No functional changes; lock granularity keeps contention minimal.
sleepy closed this pull request 2026-06-04 11:42:15 +02:00

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
area:chat

   
area:core

   
area:llm

   
area:routes

   
area:tools

   
bug
Something isn't working

  
documentation
Improvements or additions to documentation

  
duplicate
This issue or pull request already exists

  
enhancement
New feature or request

  
good first issue
Good for newcomers

  
help wanted
Extra attention is needed

  
invalid
This doesn't seem right

  
question
Further information is requested

  
refactor

   
wontfix
This will not be worked on

No labels
area:chat
area:core
area:llm
area:routes
area:tools
bug
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
refactor
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sleepy/odysseus!832
No description provided.