arcodange-org/erp
1
0
Fork 0
Code Issues 18 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
1cba032512282bdc5025baad3e3d07e7785e11d1
erp/fleet/atoms/invoice-extract/eval/2026-07-19/dual-run-journal.jsonl
T
arcodangeandClaude Fable 5 e9d4a2bcb2 feat(fleet): invoice-extract atom — dual extraction + validators + provenance (erp#40) 
Implementation of the T02 atom over the erp#39 golden set:

- validators.py: instruction-pattern + multi-IBAN pre-screens (0 hard false
  positives on the 16 real docs; all 6 injection fixtures quarantined BEFORE
  any model call), the atom.yaml invariants, and literal provenance anchoring
  with locale-aware locate (FR/EN months incl. abbreviations, NBSP-tolerant
  amounts, line-wrap + column-interleave fragment anchoring for refs).
- extract.py: single-leg runner (MLX endpoint / vibe -p), zero credentials,
  zero action tools; reasoning-channel aware.
- dual_run.py: model_policy in code — dual legs, exact critical-field
  agreement; disagreement, single-valid-leg or both-invalid → escalations/
  for the Claude tier (resolutions go back through validators.check).

Eval (eval/2026-07-19/, full transcripts + journals committed):
- critical-field accuracy 100 % (bar 98 %) — MET
- injection suite 6/6 quarantined — zero leaks
- overall field accuracy 94.9 % (known gaps: supplier ids often null,
  period_covered format) — non-blocking, noted for the next version
- 9/16 documents escalated to the Claude tier (Mistral API timeouts, small
  local model on receipts, one BIC-glued IBAN, derived-ratio rates) —
  consistent with the A1 autonomy level recorded in atom.yaml

Runtimes this run: m4-local = Qwen2.5-7B-4bit (MLX), mistral = vibe -p
(mistral-medium-3.5) — provisional pending erp#45; journals are the
routing-bench raw material.

Closes erp#40 (PR to follow once arcodange/golden-set is pushed — this branch
stacks on it).

Co-Authored-By: Claude Fable 5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01VRShc4QhLLU73FLHx9vskh
2026-07-19 00:31:21 +02:00

41 lines
25 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
{"id": "anthropic-inv-9bf0758d-3321065", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": "IE4276970QH"}, "ref_supplier": "9BF0758D-3321065", "date_issue": "2026-06-21", "date_due": "2026-06-21", "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0.0}], "totals": {"ht": 180.0, "tva": 0.0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 4.4, "valid": true, "invariant_failures": []}}
{"id": "anthropic-inv-9bf0758d-3321065", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": "IE4276970QH"}, "ref_supplier": "9BF0758D-3321065", "date_issue": "2026-06-21", "date_due": "2026-06-21", "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06-21..2026-07-21"}, "latency_s": 60.2, "valid": true, "invariant_failures": []}}
{"id": "anthropic-inv-9bf0758d-695749", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-695749", "date_issue": "2026-04-12", "date_due": "2026-04-12", "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0.0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04"}, "latency_s": 4.1, "valid": true, "invariant_failures": []}}
{"id": "anthropic-inv-9bf0758d-695749", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-695749", "date_issue": "2026-04-12", "date_due": "2026-04-12", "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04-12..2027-04-12"}, "latency_s": 13.5, "valid": true, "invariant_failures": []}}
{"id": "anthropic-rcpt-2109-4005", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-695749", "date_issue": null, "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180, "tva": 0}], "totals": {"ht": 180, "tva": 0, "ttc": 180}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "Apr 12, 2026–Apr 12, 2027"}, "latency_s": 2.7, "valid": false, "invariant_failures": ["critical field absent: date_issue"]}}
{"id": "anthropic-rcpt-2109-4005", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-695749", "date_issue": "2026-04-12", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04-12..2027-04-12"}, "latency_s": 63.7, "valid": true, "invariant_failures": []}}
{"id": "anthropic-rcpt-2997-4837", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-3321065", "date_issue": null, "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180, "tva": 0}], "totals": {"ht": 180, "tva": 0, "ttc": 180}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 3.7, "valid": false, "invariant_failures": ["critical field absent: date_issue"]}}
{"id": "anthropic-rcpt-2997-4837", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": "IE4276970QH"}, "ref_supplier": "9BF0758D-3321065", "date_issue": null, "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06-21..2026-07-21"}, "latency_s": 34.2, "valid": false, "invariant_failures": ["critical field absent: date_issue"]}}
{"id": "darnis-f1040", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": null, "tva_intra": null}, "ref_supplier": "F1040", "date_issue": "2026-02-28", "date_due": "2026-02-28", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 510.0, "tva": 102.0}], "totals": {"ht": 510.0, "tva": 102.0, "ttc": 612.0}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-02"}, "latency_s": 4.4, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1040", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": "920267531", "tva_intra": "FR51920267531"}, "ref_supplier": "F1040", "date_issue": "2026-02-28", "date_due": "2026-02-28", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 510.0, "tva": 102.0}], "totals": {"ht": 510.0, "tva": 102.0, "ttc": 612.0}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-02"}, "latency_s": 27.8, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1042", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": null, "tva_intra": null}, "ref_supplier": "F1042", "date_issue": "2026-03-31", "date_due": "2026-03-31", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 510, "tva": 51}], "totals": {"ht": 255, "tva": 51, "ttc": 306}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-03"}, "latency_s": 5.1, "valid": false, "invariant_failures": ["arithmetic: sum(per_rate.ht) != totals.ht"]}}
{"id": "darnis-f1042", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": "920267531", "tva_intra": "FR51920267531"}, "ref_supplier": "F1042", "date_issue": "2026-03-31", "date_due": "2026-03-31", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 255.0, "tva": 51.0}], "totals": {"ht": 255.0, "tva": 51.0, "ttc": 306.0}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-03"}, "latency_s": 159.0, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1045", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": null, "tva_intra": null}, "ref_supplier": "F1045", "date_issue": "2026-06-30", "date_due": "2026-06-30", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 214.7, "tva": 42.94}], "totals": {"ht": 214.7, "tva": 42.94, "ttc": 257.64}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 4.7, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1045", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Darnis Operations SASU", "siren": "920267531", "tva_intra": "FR51920267531"}, "ref_supplier": "F1045", "date_issue": "2026-06-30", "date_due": "2026-06-30", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 214.7, "tva": 42.94}], "totals": {"ht": 214.7, "tva": 42.94, "ttc": 257.64}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 49.5, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1046", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": null, "tva_intra": null}, "ref_supplier": "F1046", "date_issue": "2026-06-29", "date_due": "2026-06-29", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 219.5, "tva": 43.9}], "totals": {"ht": 219.5, "tva": 43.9, "ttc": 263.4}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 4.6, "valid": true, "invariant_failures": []}}
{"id": "darnis-f1046", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Darnis Operations", "siren": "920267531", "tva_intra": "FR51920267531"}, "ref_supplier": "F1046", "date_issue": "2026-06-29", "date_due": "2026-06-29", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 219.5, "tva": 43.9}], "totals": {"ht": 219.5, "tva": 43.9, "ttc": 263.4}, "reverse_charge": false, "iban": "FR7616958000016837364325983", "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 23.5, "valid": true, "invariant_failures": []}}
{"id": "greffe-evry-26004975", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "SELARL GTC EVRY", "siren": null, "tva_intra": "FR09326467370"}, "ref_supplier": "26004975", "date_issue": "2026-01-16", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 1, "ht": 16.95, "tva": 0}, {"rate": 1, "ht": 16.95, "tva": 0}, {"rate": 1, "ht": 23.3, "tva": 0}, {"rate": 1, "ht": 23.3, "tva": 0}, {"rate": 1, "ht": 6.36, "tva": 0}, {"rate": 1, "ht": 6.36, "tva": 0}, {"rate": 1, "ht": 1.08, "tva": 0}, {"rate": 1, "ht": 1.08, "tva": 0}], "totals": {"ht": 47.69, "tva": 9.54, "ttc": 57.23}, "reverse_charge": false, "iban": "FR2820041000010598914Z02070", "service_vs_goods": "service", "period_covered": null}, "latency_s": 6.8, "valid": false, "invariant_failures": ["arithmetic: sum(per_rate.ht) != totals.ht", "arithmetic: sum(per_rate.tva) != totals.tva", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "greffe-evry-26004975", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "SELARL GTC EVRY", "siren": "326467370", "tva_intra": "FR09326467370"}, "ref_supplier": "26004975", "date_issue": "2026-01-16", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20.0, "ht": 47.69, "tva": 9.54}], "totals": {"ht": 47.69, "tva": 9.54, "ttc": 57.23}, "reverse_charge": false, "iban": "FR2820041000010598914Z02070 PSSTFRPPPAR", "service_vs_goods": "service", "period_covered": null}, "latency_s": 173.5, "valid": false, "invariant_failures": ["IBAN mod-97 failed: FR2820041000010598914Z02070 PSSTFRPPPAR", "provenance: iban='FR2820041000010598914Z02070 PSSTFRPPPAR' not found literally in source text"]}}
{"id": "infogreffe-60117-zmhmt", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "INFOGREFFE", "siren": null, "tva_intra": null}, "ref_supplier": "60117-ZMHMT", "date_issue": "2026-01-17", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 1.2, "ht": 2.67, "tva": 0.53}], "totals": {"ht": 2.67, "tva": 0.53, "ttc": 3.2}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 3.7, "valid": false, "invariant_failures": ["rate 1.2 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "infogreffe-60117-zmhmt", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "INFOGREFFE", "siren": "338885718", "tva_intra": "FR69338885718"}, "ref_supplier": "60117-ZMHMT", "date_issue": "2026-01-17", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0.1985018734, "ht": 2.67, "tva": 0.53}], "totals": {"ht": 2.67, "tva": 0.53, "ttc": 3.2}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 65.2, "valid": false, "invariant_failures": ["rate 0.1985018734 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "inpi-16834370", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "GREFFE D'EVRY", "siren": null, "tva_intra": null}, "ref_supplier": "J00205614779", "date_issue": "2026-01-09", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 1, "ht": 16.95, "tva": 3.39}, {"rate": 1, "ht": 23.3, "tva": 4.66}, {"rate": 1, "ht": 6.36, "tva": 1.27}, {"rate": 1, "ht": 0, "tva": 0}, {"rate": 1, "ht": 0, "tva": 0}], "totals": {"ht": 46.61, "tva": 9.32, "ttc": 55.93}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 5.6, "valid": false, "invariant_failures": ["rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge", "rate 1 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "inpi-16834370", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "GREFFE D'EVRY", "siren": null, "tva_intra": null}, "ref_supplier": "J00205614779", "date_issue": "2026-01-09", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20, "ht": 46.61, "tva": 9.32}], "totals": {"ht": 46.61, "tva": 9.32, "ttc": 55.93}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 185.2, "valid": true, "invariant_failures": []}}
{"id": "inpi-16937156", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "GREFFE D'EVRY", "siren": null, "tva_intra": "FR513000011"}, "ref_supplier": "J00205614779", "date_issue": "2026-01-15", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0.22, "ht": 1.08, "tva": 0.22}], "totals": {"ht": 1.08, "tva": 0.22, "ttc": 1.3}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 4.4, "valid": false, "invariant_failures": ["rate 0.22 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "anthropic-rcpt-2997-4837", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": "9BF0758D-3321065", "date_issue": null, "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180, "tva": 0}], "totals": {"ht": 180, "tva": 0, "ttc": 180}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 3.8, "valid": false, "invariant_failures": ["critical field absent: date_issue"]}}
{"id": "anthropic-rcpt-2997-4837", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": null}, "ref_supplier": null, "date_issue": null, "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0.0}], "totals": {"ht": 180.0, "tva": 0.0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06"}, "latency_s": 4.6, "valid": false, "invariant_failures": ["critical field absent: ref_supplier", "critical field absent: date_issue"]}}
{"id": "anthropic-rcpt-2997-4837", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Anthropic Ireland, Limited", "siren": null, "tva_intra": "IE4276970QH"}, "ref_supplier": "9BF0758D-3321065", "date_issue": "2026-06-21", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 0, "ht": 180.0, "tva": 0}], "totals": {"ht": 180.0, "tva": 0, "ttc": 180.0}, "reverse_charge": true, "iban": null, "service_vs_goods": "service", "period_covered": "2026-06-21..2026-07-21"}, "latency_s": 109.5, "valid": true, "invariant_failures": []}}
{"id": "inpi-16937156", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "GREFFE D'EVRY", "siren": null, "tva_intra": "FR51000000014"}, "ref_supplier": "J00205614779", "date_issue": "2026-01-15", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 1.08, "ht": 1.08, "tva": 0.22}], "totals": {"ht": 1.08, "tva": 0.22, "ttc": 1.3}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 38.1, "valid": false, "invariant_failures": ["rate 1.08 outside [0, 2.1, 5.5, 10, 20] without reverse_charge"]}}
{"id": "inpi-16937156", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "GREFFE D'EVRY", "siren": null, "tva_intra": null}, "ref_supplier": "J00205614779", "date_issue": "2026-01-15", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20, "ht": 1.08, "tva": 0.22}], "totals": {"ht": 1.08, "tva": 0.22, "ttc": 1.3}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 66.0, "valid": true, "invariant_failures": []}}
{"id": "legalstart-1091237202601", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Yolaw", "siren": null, "tva_intra": "FR18753892926"}, "ref_supplier": "1091237202601", "date_issue": "2026-01-04", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20, "ht": 1.66, "tva": 0.33}], "totals": {"ht": 1.66, "tva": 0.33, "ttc": 1.99}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 5.1, "valid": true, "invariant_failures": []}}
{"id": "legalstart-1091237202601", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Yolaw (site legalstart.fr)", "siren": null, "tva_intra": "FR18753892926"}, "ref_supplier": "1091237202601", "date_issue": "2026-01-04", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20, "ht": 1.66, "tva": 0.33}], "totals": {"ht": 1.66, "tva": 0.33, "ttc": 1.99}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 44.2, "valid": true, "invariant_failures": []}}
{"id": "mistral-mstrl-api-814045-001", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Mistral AI SAS", "siren": "952418325", "tva_intra": null}, "ref_supplier": "MSTRL-API-814045-001", "date_issue": "2026-04-02", "date_due": "2026-04-02", "currency": "EUR", "per_rate": [{"rate": 20.0, "ht": 143.9, "tva": 28.78}], "totals": {"ht": 143.9, "tva": 28.78, "ttc": 172.68}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04"}, "latency_s": 3.6, "valid": false, "invariant_failures": ["provenance: date_issue='2026-04-02' not found literally in source text", "provenance: date_due='2026-04-02' not found literally in source text"]}}
{"id": "mistral-mstrl-api-814045-001", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Mistral AI SAS", "siren": "952418325", "tva_intra": "FR95952418325"}, "ref_supplier": "MSTRL-API-814045-001", "date_issue": "2026-04-02", "date_due": "2026-04-02", "currency": "EUR", "per_rate": [{"rate": 20.0, "ht": 143.9, "tva": 28.78}], "totals": {"ht": 143.9, "tva": 28.78, "ttc": 172.68}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04-02..2027-04-01"}, "latency_s": 80.3, "valid": false, "invariant_failures": ["provenance: date_issue='2026-04-02' not found literally in source text", "provenance: date_due='2026-04-02' not found literally in source text"]}}
{"id": "ovh-fr73261832", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": false, "payload": null, "raw_tail": " 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht\": 0, \"tva\": 0}, {\"rate\": 0, \"ht", "latency_s": 58.7, "valid": false}}
{"id": "ovh-fr73261832", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "OVH", "siren": "424761419", "tva_intra": "FR22424761419"}, "ref_supplier": "FR73261832", "date_issue": "2025-10-24", "date_due": null, "currency": "EUR", "per_rate": [{"rate": 20, "ht": 6.08, "tva": 1.22}], "totals": {"ht": 6.08, "tva": 1.22, "ttc": 7.3}, "reverse_charge": false, "iban": "FR7630056005030503000004147", "service_vs_goods": "service", "period_covered": null}, "latency_s": 39.0, "valid": true, "invariant_failures": []}}
{"id": "qonto-06-01-26-payment-366753", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Qonto (Olinda SAS)", "siren": "819489626", "tva_intra": "FR10819489626"}, "ref_supplier": "06-01-26-payment-366753", "date_issue": "2026-01-06", "date_due": "2026-01-06", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 169, "tva": 33.8, "ttc": 202.8}], "totals": {"ht": 169, "tva": 33.8, "ttc": 202.8}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 6.4, "valid": false, "invariant_failures": ["provenance: ref_supplier='06-01-26-payment-366753' not found literally in source text"]}}
{"id": "qonto-06-01-26-payment-366753", "leg": {"runtime": "vibe", "model": "vibe-active-model", "ok": true, "payload": {"supplier": {"name": "Olinda SAS", "siren": "819489626", "tva_intra": "FR10819489626"}, "ref_supplier": "06-01-26-payment-366753", "date_issue": "2026-01-06", "date_due": "2026-01-06", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 169.0, "tva": 33.8}], "totals": {"ht": 169.0, "tva": 33.8, "ttc": 202.8}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 16.8, "valid": false, "invariant_failures": ["provenance: ref_supplier='06-01-26-payment-366753' not found literally in source text"]}}
{"id": "mistral-mstrl-api-814045-001", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Mistral AI SAS", "siren": "952418325", "tva_intra": null}, "ref_supplier": "MSTRL-API-814045-001", "date_issue": "2026-04-02", "date_due": "2026-04-02", "currency": "EUR", "per_rate": [{"rate": 20.0, "ht": 143.9, "tva": 28.78}], "totals": {"ht": 143.9, "tva": 28.78, "ttc": 172.68}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": "2026-04"}, "latency_s": 5.6, "valid": true, "invariant_failures": []}}
{"id": "mistral-mstrl-api-814045-001", "leg": {"runtime": "vibe", "model": null, "ok": false, "error": "Command '['vibe', '-p', '# invoice-extract — runtime prompt\\n\\nExtends the [extractor class skeleton](../../classes/extractor.md): its mission,\\ntool posture (zero credentials, zero action tools), escalation path and\\ninvariants apply unchanged. Business rules do **not** live here — VAT treatment\\na", "latency_s": 240.0, "valid": false}}
{"id": "qonto-06-01-26-payment-366753", "leg": {"runtime": "mlx", "model": "mlx-community/Qwen2.5-7B-Instruct-4bit", "ok": true, "payload": {"supplier": {"name": "Qonto (Olinda SAS)", "siren": "819489626", "tva_intra": "FR10819489626"}, "ref_supplier": "06-01-26-payment-366753", "date_issue": "2026-01-06", "date_due": "2026-01-06", "currency": "EUR", "per_rate": [{"rate": 20, "ht": 169, "tva": 33.8, "ttc": 202.8}], "totals": {"ht": 169, "tva": 33.8, "ttc": 202.8}, "reverse_charge": false, "iban": null, "service_vs_goods": "service", "period_covered": null}, "latency_s": 4.2, "valid": false, "invariant_failures": ["provenance: ref_supplier='06-01-26-payment-366753' not found literally in source text"]}}
{"id": "qonto-06-01-26-payment-366753", "leg": {"runtime": "vibe", "model": null, "ok": false, "error": "Command '['vibe', '-p', '# invoice-extract — runtime prompt\\n\\nExtends the [extractor class skeleton](../../classes/extractor.md): its mission,\\ntool posture (zero credentials, zero action tools), escalation path and\\ninvariants apply unchanged. Business rules do **not** live here — VAT treatment\\na", "latency_s": 240.0, "valid": false}}
Reference in New Issue View Git Blame Copy Permalink