Files

T

sleepy 51123212c4 Initial commit: coding harness feedback analysis

Harnesses under analysis:
- opencode (Go-based coding agent)
- pi (minimal terminal coding harness by Mario Zechner)
- hermes (Nous Research agent)
- forgecode (AI pair programmer with sub-agents)

Each harness folder contains:
- repo/: Source code from respective repositories
- feedback/localllm/: Community feedback for local/smaller models
- feedback/frontier/: Community feedback for frontier models

Research focus: Tool handling, skills systems, prompt engineering,
context management, and best practices for smaller/local models.

2026-04-09 15:13:45 +02:00

3.5 KiB

Raw Blame History

GitHub Issues Summary for ForgeCode

Scope: Open and recently closed issues affecting model performance
Repository: antinomyhq/forgecode
Stats: 48 open, 433 closed (as of April 9, 2026)
Date Compiled: April 9, 2026

Critical Open Issues

#2904: Use models.dev as LLM model registry source

Status: Open (April 9, 2026)
Type: Enhancement
Impact: Would improve model discovery and configuration

#2894: Multiple system messages break models with strict chat templates (e.g. Qwen3.5)

Status: Open (April 8, 2026)
Type: Bug
Impact: BREAKS local models with strict templates
Affected Models: Qwen3.5, potentially others
Workaround: None yet

#2893: Terminal output disappears on window resize in Ghostty

Status: Open (April 8, 2026)
Type: Bug
Impact: UI/usability issue
Linked PR: 1 linked PR

#2888: Add support for API key helpers

Status: Open (April 8, 2026)
Type: Feature
Impact: Would improve security (helper scripts for API keys)

#2884: Muse mode shell blocked

Status: Open (April 7, 2026)
Type: Bug
Impact: Blocks usage of muse agent for planning

Historical Issues (Now Fixed)

#2813: (Fixed)

Fixed issue referenced in Reddit response from maintainer
Source: Reddit r/ClaudeCode

#2485: Installation issues on Mac

Symptoms: Oh My Zsh not found, terminal configuration issues
Resolution: Install Oh My Zsh separately

#1296: Daily FORGE limit stops tasks mid-execution

Problem: Cannot switch providers when daily limit reached
Impact: Context built up is lost
Status: Open (feature request)

Model-Specific Issues

GPT 5.4

Tool calling reliability: Improved via schema reordering
Status: Workarounds implemented

Qwen 3.5

Multiple system messages: Open issue #2894
Tool calling format: Use LM Studio 0.4.9+ for better compatibility

Gemma 4

Tool calling: Requires latest llama.cpp/oMLX
Status: Resolved with backend updates

Privacy/Security Issues

#1318: Telemetry concerns

Collection: Git emails, SSH directory scans, conversation data
Mitigation: FORGE_TRACKER=false
Status: Documented mitigation available

Linked to: Discussion #2545

ZSH/Terminal Issues

Shell Integration

Issue: ZSH aliases don't work in interactive mode (by design)
Solution: Use : sentinel from native ZSH session

Oh My Zsh

Requirement: Not strictly required but recommended
Error: Install script warns if not present

Ghostty Terminal

Issue: #2893 - Output disappears on resize
Status: Under investigation

Installation Issues

macOS

Common: iTerm + Oh My Zsh configuration issues
Fix: Run forge zsh doctor and forge zsh setup

Windows

Support: Via WSL or Git Bash only
Native: Not officially supported

Linux

Best supported platform
Android: Also supported

Issue Resolution Tips

From documentation:

forge zsh doctor  # Check environment
forge zsh setup   # Re-run ZSH integration

Source References

GitHub Issues: https://github.com/antinomyhq/forgecode/issues
GitHub Discussions: https://github.com/antinomyhq/forgecode/discussions
Reddit r/ClaudeCode: https://www.reddit.com/r/ClaudeCode/comments/1royhni/someone_is_using_forgecodedev/

3.5 KiB Raw Blame History