arcodangeandClaude Fable 5
ceb4321224
- runs/2026-07-18/: the 8 sha256-pinned verifier transcripts (4 runtimes × 2 tests), blind-judging verdicts (2 independent judges per cell, unanimous), the erp#56 builder-bench journal + prompt + caps, and the evidence README with the parity table. - run-verifier.sh: mistral runtime drops the tool-filter flag (--enabled-tools with a no-match pattern hangs vibe 2.21.0); plain -p with --max-turns 1. Verdicts: Mistral (vibe -p, mistral-medium-3.5) and Ornith 35B (hermes MLX) reach verdict parity with the Claude baseline on both tests → admitted to verifier duty. Qwen2.5-7B-4bit fails both → the honest small-model floor. Builder bench: erp#56 completed by the Mistral runtime, 0 code corrections, 261 s, acceptance run clean (0 bank-UNKNOWN) → merged as PR #68. Closes #63 (with the paired factory qa-strategy PR). Co-Authored-By: Claude Fable 5 <[email protected]> Claude-Session: https://claude.ai/code/session_01VRShc4QhLLU73FLHx9vskh
16 lines
1.2 KiB
JSON
16 lines
1.2 KiB
JSON
{
|
|
"test": "locate",
|
|
"runtime": "claude",
|
|
"model": "claude-fable-5 (context-free subagent)",
|
|
"endpoint": "Claude Code Agent tool; single Read of the pinned assembled prompt file, no other tools",
|
|
"timestamp": "20260718T1850",
|
|
"latency_s": null,
|
|
"prompt_sha256": "6cb373e229d4d58965e5e5b718400178afbbf83f02eed59f2fab5895df1edc0f",
|
|
"inputs": {
|
|
"AGENTS.md": {
|
|
"path": "/Users/gabrielradureau/Work/Arcodange/erp/.claude/worktrees/harness-portability/AGENTS.md",
|
|
"sha256": "a77d356e7804d2792b605bef2e9daba0233d93ef791675acda021d2dac9b02a6"
|
|
}
|
|
},
|
|
"response": "Per AGENTS.md:\n\n- **Atom registry**: `fleet/README.md` — defines what an atom is, the `atom.yaml` contract schema field by field, and the `fleet/` layout. An atom absent from the registry does not run.\n- **Class skeletons**: `fleet/classes/` — the 7 prompt skeletons per the PRD agent catalog; every atom's `prompt.md` extends exactly one, and prompts carry no business rules (those live in `fleet/profile/` + validators).\n- **Environment rules**: the \"Operating rules for agents\" section of AGENTS.md itself, plus `.claude/skills/dolibarr-sandbox-write/SKILL.md` (the host-guarded sandbox write path and its promote gate).\n"
|
|
} |