[core] Services layer - Inference, ModelManager, SessionManager, WebSearch #2

Closed
opened 2026-05-22 12:19:06 +02:00 by sleepy · 0 comments
Owner

Build all service classes:

  • InferenceService: MLX Swift Gemma 4 inference with streaming, handles text/image/audio input
  • ModelManager: Download models from HuggingFace mlx-community, manage local storage, Q4/Q8 selection
  • SessionManager: CRUD for conversations, JSON persistence to app documents directory
  • WebSearchService: SearXNG API client, configurable endpoint, search+fetch operations
Build all service classes: - InferenceService: MLX Swift Gemma 4 inference with streaming, handles text/image/audio input - ModelManager: Download models from HuggingFace mlx-community, manage local storage, Q4/Q8 selection - SessionManager: CRUD for conversations, JSON persistence to app documents directory - WebSearchService: SearXNG API client, configurable endpoint, search+fetch operations
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sleepy/Gemma4Pad#2
No description provided.