chore(fleet): erp#63 evidence — verifier parity + builder bench transcripts

- runs/2026-07-18/: the 8 sha256-pinned verifier transcripts (4 runtimes ×
  2 tests), blind-judging verdicts (2 independent judges per cell, unanimous),
  the erp#56 builder-bench journal + prompt + caps, and the evidence README
  with the parity table.
- run-verifier.sh: mistral runtime drops the tool-filter flag (--enabled-tools
  with a no-match pattern hangs vibe 2.21.0); plain -p with --max-turns 1.

Verdicts: Mistral (vibe -p, mistral-medium-3.5) and Ornith 35B (hermes MLX)
reach verdict parity with the Claude baseline on both tests → admitted to
verifier duty. Qwen2.5-7B-4bit fails both → the honest small-model floor.
Builder bench: erp#56 completed by the Mistral runtime, 0 code corrections,
261 s, acceptance run clean (0 bank-UNKNOWN) → merged as PR #68.

Closes #63 (with the paired factory qa-strategy PR).

Co-Authored-By: Claude Fable 5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01VRShc4QhLLU73FLHx9vskh
This commit is contained in:
2026-07-18 19:56:55 +02:00
co-authored by Claude Fable 5
parent f2a60817e2
commit ceb4321224
15 changed files with 2290 additions and 1 deletions
@@ -0,0 +1,16 @@
{
"test": "locate",
"runtime": "ornith",
"model": "leonsarmiento/Ornith-1.0-35B-5bit-mlx",
"endpoint": "http://127.0.0.1:18080/v1",
"timestamp": "20260718T185032",
"latency_s": 18,
"prompt_sha256": "6cb373e229d4d58965e5e5b718400178afbbf83f02eed59f2fab5895df1edc0f",
"inputs": {
"AGENTS.md": {
"path": "/Users/gabrielradureau/Work/Arcodange/erp/.claude/worktrees/harness-portability/AGENTS.md",
"sha256": "69206359ba2bea471e7f325684465124f0dae6183bf509ffda5bfae9b596dd15"
}
},
"response": "\n\nBased on `AGENTS.md` alone:\n\n- **Atom registry**: `fleet/README.md` (defines what an atom is, the `atom.yaml` contract schema, and the `fleet/` layout)\n- **Class skeletons**: `fleet/classes/`\n- **Environment rules**: The `## Operating rules for agents` section in this file, plus `.claude/skills/dolibarr-sandbox-write/SKILL.md` (the host-guarded sandbox write path and promote gate)"
}