Initial commit: coding harness feedback analysis

Harnesses under analysis: - opencode (Go-based coding agent) - pi (minimal terminal coding harness by Mario Zechner) - hermes (Nous Research agent) - forgecode (AI pair programmer with sub-agents) Each harness folder contains: - repo/: Source code from respective repositories - feedback/localllm/: Community feedback for local/smaller models - feedback/frontier/: Community feedback for frontier models Research focus: Tool handling, skills systems, prompt engineering, context management, and best practices for smaller/local models.
2026-04-09 15:13:45 +02:00
commit 51123212c4
46 changed files with 7213 additions and 0 deletions
@@ -0,0 +1,146 @@
+# ForgeCode vs Competitors - Feature & Ecosystem Comparison
+
+**Topic:** Feature gaps, ecosystem comparison, workflow integration  
+**Source References:** DEV Community, ForgeCode docs, Reddit  
+**Date Compiled:** April 9, 2026
+
+---
+
+## Feature Matrix
+
+| Feature | ForgeCode | Claude Code | Cursor |
+|---------|-----------|-------------|--------|
+| **Model Choice** | Any (300+) | Claude only | Multiple |
+| **License** | Open source (Apache 2.0) | Proprietary | Proprietary |
+| **Language** | Rust | TypeScript | TypeScript |
+| **Project Config** | `AGENTS.md` | `CLAUDE.md` (hierarchical) | `.cursorrules` |
+| **MCP Support** | Yes | Yes (extensive) | Yes |
+| **Hooks** | **No** | Yes (6 types) | Limited |
+| **Scheduled Tasks** | **No** | Yes (cloud + local) | No |
+| **Sub-agents** | Yes (forge/sage/muse) | Yes (parallel) | Limited |
+| **IDE Extensions** | **None** | VS Code, JetBrains | VS Code only |
+| **Auto-Memory** | **No** | Yes | Yes |
+| **Checkpoints/Rewind** | **No** | Yes | Yes |
+| **Sandbox Mode** | `--sandbox` flag | Built-in | Built-in |
+| **Plan Mode** | Yes (muse writes to `plans/`) | Yes (Shift+Tab) | Composer |
+| **Pricing** | $0-$100/mo + API | $20/mo subscription | $20/mo subscription |
+
+---
+
+## The "Lambo with No Cup Holder" Problem
+
+> "ForgeCode is a Lambo with no cup holder. Fast as hell, but you're holding your coffee between your knees."
+
+**Meaning:** Extremely fast but missing quality-of-life features.
+
+---
+
+## Major Feature Gaps
+
+### 1. No IDE Extensions
+**Impact:** Must use terminal exclusively; no GUI integration
+**Workaround:** Use alongside IDE manually
+
+### 2. No Auto-Memory
+**Impact:** Context doesn't persist between sessions
+**Claude Code Comparison:** Remembers project context across sessions
+
+### 3. No Checkpoints/Rewind
+**Impact:** Cannot rollback changes without git
+**Claude Code Comparison:** Every edit snapshotted; `/rewind` available
+
+### 4. No Hooks
+**Impact:** Cannot trigger scripts on file changes
+**Claude Code Comparison:** 6 hook types (pre-command, post-command, etc.)
+
+### 5. No Scheduled Tasks
+**Impact:** Cannot schedule recurring agent runs
+**Claude Code Comparison:** Both cloud and local scheduled tasks
+
+---
+
+## ForgeCode Strengths
+
+### 1. Speed
+- Rust binary vs TypeScript runtime
+- Context indexing reduces token usage ~90%
+- Real-world: 3x faster on identical tasks
+
+### 2. Multi-Model Support
+- 300+ models via OpenRouter
+- Not locked to single provider
+- Can optimize cost/performance per task
+
+### 3. Multi-Agent Architecture
+- `forge`: Implementation
+- `sage`: Read-only research
+- `muse`: Planning (writes to `plans/`)
+- More detailed plan output than competitors
+
+### 4. Open Source
+- Apache 2.0 license
+- Auditable code
+- Community contributions
+
+### 5. Terminal-Native
+- Zsh plugin integration
+- `:` sentinel for quick access
+- No context switching
+
+---
+
+## Workflow Integration Patterns
+
+### Pattern 1: ForgeCode for Speed
+**Use Case:** Latency-sensitive tasks, quick fixes
+**Workflow:** Use ForgeCode for implementation, IDE for review
+
+### Pattern 2: Double-Dipping
+**User Quote:** "I double-dip. Claude Code for my primary workflow (ecosystem, features), ForgeCode when I care about latency."
+
+### Pattern 3: Team Configuration
+**Challenge:** No shared project instructions (CLAUDE.md is Claude-specific)
+**Partial Solution:** AGENTS.md for ForgeCode, but not widely adopted
+
+---
+
+## AGENTS.md vs CLAUDE.md
+
+### AGENTS.md (ForgeCode)
+- Project-specific instructions
+- Less widely documented
+- Single file (no hierarchy)
+
+### CLAUDE.md (Claude Code)
+- Hierarchical (project → parent dirs → home)
+- More mature documentation
+- Shared across team if committed
+
+---
+
+## Recommendations by Use Case
+
+### Solo Developer, Speed Priority
+**Choice:** ForgeCode + Opus 4.6
+**Reason:** Fastest iteration, cost-effective with careful model selection
+
+### Team Environment
+**Choice:** Claude Code
+**Reason:** Shared CLAUDE.md, checkpoints, auto-memory for team continuity
+
+### IDE-First Developer
+**Choice:** Cursor
+**Reason:** Native IDE integration, GUI features
+
+### Terminal-First, Privacy-Focused
+**Choice:** ForgeCode (with FORGE_TRACKER=false)
+**Reason:** Local execution, open source, no IDE lock-in
+
+---
+
+## Source References
+
+1. **DEV Community:** https://dev.to/liran_baba/forgecode-vs-claude-code-which-ai-coding-agent-actually-wins-36c
+2. **ForgeCode Docs:** https://forgecode.dev/docs/operating-agents/
+3. **ForgeCode ZSH Docs:** https://forgecode.dev/docs/zsh-support/
+4. **Reddit r/ClaudeCode:** https://www.reddit.com/r/ClaudeCode/comments/1royhni/someone_is_using_forgecodedev/