feat(fleet): invoice-extract atom — dual extraction + validators + provenance (erp#40)

Implementation of the T02 atom over the erp#39 golden set:

- validators.py: instruction-pattern + multi-IBAN pre-screens (0 hard false
  positives on the 16 real docs; all 6 injection fixtures quarantined BEFORE
  any model call), the atom.yaml invariants, and literal provenance anchoring
  with locale-aware locate (FR/EN months incl. abbreviations, NBSP-tolerant
  amounts, line-wrap + column-interleave fragment anchoring for refs).
- extract.py: single-leg runner (MLX endpoint / vibe -p), zero credentials,
  zero action tools; reasoning-channel aware.
- dual_run.py: model_policy in code — dual legs, exact critical-field
  agreement; disagreement, single-valid-leg or both-invalid → escalations/
  for the Claude tier (resolutions go back through validators.check).

Eval (eval/2026-07-19/, full transcripts + journals committed):
- critical-field accuracy 100 % (bar 98 %) — MET
- injection suite 6/6 quarantined — zero leaks
- overall field accuracy 94.9 % (known gaps: supplier ids often null,
  period_covered format) — non-blocking, noted for the next version
- 9/16 documents escalated to the Claude tier (Mistral API timeouts, small
  local model on receipts, one BIC-glued IBAN, derived-ratio rates) —
  consistent with the A1 autonomy level recorded in atom.yaml

Runtimes this run: m4-local = Qwen2.5-7B-4bit (MLX), mistral = vibe -p
(mistral-medium-3.5) — provisional pending erp#45; journals are the
routing-bench raw material.

Closes erp#40 (PR to follow once arcodange/golden-set is pushed — this branch
stacks on it).

Co-Authored-By: Claude Fable 5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01VRShc4QhLLU73FLHx9vskh
This commit is contained in:
2026-07-19 00:31:21 +02:00
co-authored by Claude Fable 5
parent bdd3d63b61
commit e9d4a2bcb2
38 changed files with 1678 additions and 44 deletions
@@ -0,0 +1,76 @@
{
"stage": "escalation",
"flags": [],
"legs": [
{
"runtime": "mlx",
"model": "mlx-community/Qwen2.5-7B-Instruct-4bit",
"valid": false,
"validated": null,
"invariant_failures": [
"rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge",
"rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge",
"rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge",
"rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge",
"rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"
],
"error": null
},
{
"runtime": "vibe",
"model": "vibe-active-model",
"valid": true,
"validated": {
"supplier": {
"name": "GREFFE D'EVRY",
"siren": null,
"tva_intra": null
},
"ref_supplier": "J00205614779",
"date_issue": "2026-01-09",
"date_due": null,
"currency": "EUR",
"per_rate": [
{
"rate": 20,
"ht": 46.61,
"tva": 9.32
}
],
"totals": {
"ht": 46.61,
"tva": 9.32,
"ttc": 55.93
},
"reverse_charge": false,
"iban": null,
"service_vs_goods": "service",
"period_covered": null,
"provenance": {
"totals.ht": {
"source_sha256": "6de23abd4bd18613741c6e42950b6be2fc3e269d0e6abbd8a3e20e38de99c9a3",
"raw_excerpt": "46,61"
},
"totals.tva": {
"source_sha256": "6de23abd4bd18613741c6e42950b6be2fc3e269d0e6abbd8a3e20e38de99c9a3",
"raw_excerpt": "9,32"
},
"totals.ttc": {
"source_sha256": "6de23abd4bd18613741c6e42950b6be2fc3e269d0e6abbd8a3e20e38de99c9a3",
"raw_excerpt": "55,93"
},
"ref_supplier": {
"source_sha256": "6de23abd4bd18613741c6e42950b6be2fc3e269d0e6abbd8a3e20e38de99c9a3",
"raw_excerpt": "J00205614779"
},
"date_issue": {
"source_sha256": "6de23abd4bd18613741c6e42950b6be2fc3e269d0e6abbd8a3e20e38de99c9a3",
"raw_excerpt": "09/01/2026"
}
}
},
"invariant_failures": [],
"error": null
}
]
}