Files
erp/.claude/skills/dolibarr-sandbox-write/scripts/thirdparty-create.sh
arcodangeandClaude Fable 5 3840e74dcd feat(write-skill): idempotency keys — manifest replay is a no-op (erp#44)
Learning #4 of the 2026-07-11 rehearsal: manifest B failed mid-run and could
not be re-applied — op 1 (the DARNIS invoice) had already run and a replay
would have duplicated it. Every write op now dedupes BEFORE any POST:

- thirdparty-create.sh: by exact name (promote '#thirdparty:name=' semantics);
  ambiguous (2+) aborts; an existing fiche missing the requested role aborts
  (refuse-never-repair). Emits {"id", "deduped"} instead of a bare id.
- invoice-create.sh: supplier kind by (socid, ref_supplier) — same key with a
  different total aborts as a conflict; customer kind (or supplier without
  ref_supplier) by (socid, date, total_ttc ±0.02, line fingerprint) with descs
  HTML-unescaped. Credit notes are never candidates. A deduped DRAFT with
  validate:true is validated on replay, so an interrupted run converges.
- payment-record.sh: by (invoice, amount, normalized transaction_id), composing
  with the erp#37 varchar(50) normalization on BOTH sides so historical
  long-form nums still match; same tx + different amount aborts; without a tx
  id there is no dedupe key (warned). Dedupe answers id:null (the payments list
  exposes no paiement rowid) + the existing bank line.
- All three refuse to POST blind when the dedupe lookup fails with anything but
  the documented empty-list 404 (the voir_tous trap would otherwise mint dupes).
- promote-apply.sh: marks each op created / deduped=true inline and totals them
  in the summary — an all-deduped second run is visible proof of a no-op.
- promote-plan.sh: advertises each op's dedupe key (and flags tx=MISSING as
  'a replay WILL double-pay').

Proof:
- tests/run-tests.sh: 5 new offline cases (11 total) — dedupe hits POST
  nothing, conflicts/ambiguity abort pre-POST, long-form history dedupes,
  draft convergence validates; stub extended to serve the new lookups with the
  live-observed empty behaviors ([] for invoices/payments, 404 for tiers).
- tests/replay-idempotency.sh (new, live): double-applies a self-contained
  manifest on the sandbox — run 1 '3 created' (rows 1/1/1), run 2 '3 deduped'
  with row counts unchanged and the stored num in erp#37 short form.
- The historic manifest-B now replays on the sandbox as 5/5 deduped, zero new
  rows — the exact replay Learning #4 declared impossible.

SKILL.md updated in the same change (per-op dedupe keys, replay-safety section,
gotchas); the 2026-07-11 runbook's Learning #4 carries a dated resolution
addendum.

Closes erp#44.

Co-Authored-By: Claude Fable 5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01VRShc4QhLLU73FLHx9vskh
2026-07-18 23:46:05 +02:00

133 lines
5.9 KiB
Bash
Executable File

#!/usr/bin/env bash
# Create a client and/or supplier thirdparty (fiche tiers) in the SANDBOX —
# IDEMPOTENT (erp#44): replaying the same create is a no-op, not a duplicate.
#
# Input: a JSON object on stdin (or a file path in $1). Fields:
# name (required)
# role "client" | "supplier" | "both" (default "client")
# country_id numeric, default 1 (France)
# client_code / supplier_code default "-1" = auto-generate via the code mask
# siret, tva_intra, address, zip, town, email, phone, idprof1 (optional)
#
# Idempotency (erp#44): BEFORE any POST, look the name up on the target with the
# same semantics as promote-apply's `#thirdparty:name=...` lookup
# (GET /thirdparties?sqlfilters=(t.nom:=:'name'), limit 2):
# - 0 matches (the API answers HTTP 404, not []) -> create
# - 1 match whose roles cover the requested role -> {"id": <existing>, "deduped": true}
# - 1 match MISSING the requested role -> ABORT (refuse-never-repair:
# silently reusing a client fiche as a supplier would skip the code mask and
# hide a data problem — fix the fiche deliberately, not as a create side effect)
# - 2+ matches -> ABORT (ambiguous, never guess)
# Any other listing failure ABORTS: assuming "no match" on e.g. a 403 would mint
# duplicates — the exact failure mode this dedupe exists to prevent.
#
# Emits {"id": N, "deduped": false} after a create, {"id": N, "deduped": true}
# after a dedupe hit. All writes go through dol-write.sh, which refuses any host
# that is not the sandbox.
#
# Examples:
# echo '{"name":"KissMetrics","role":"client","tva_intra":"US.."}' | thirdparty-create.sh
# thirdparty-create.sh fournisseur.json
set -euo pipefail
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
W="${DOL_WRITE:-${SCRIPT_DIR}/dol-write.sh}"
SRC="${1:-}"
if [[ -n "${SRC}" && "${SRC}" != "-" ]]; then INPUT="$(cat "${SRC}")"; else INPUT="$(cat)"; fi
TMPD="$(mktemp -d -t tpcre.XXXXXX)"; trap 'rm -rf "${TMPD}"' EXIT
# --- 1. Validate + map the POST body (before ANY request) ----------------------
cat > "${TMPD}/map.py" <<'PY'
import json, sys, urllib.parse
d = json.loads(sys.stdin.read())
if not d.get("name"):
sys.exit("thirdparty-create.sh: 'name' is required")
role = d.get("role", "client").lower()
is_client = role in ("client", "both")
is_supp = role in ("supplier", "fournisseur", "both")
body = {
"name": d["name"],
"client": "1" if is_client else "0",
"fournisseur": "1" if is_supp else "0",
"country_id": str(d.get("country_id", 1)),
# "-1" => Dolibarr auto-assigns the next code from the mask
# (COMPANY_ELEPHANT_MASK_CUSTOMER / _SUPPLIER); "0" when that role is off.
"code_client": (d.get("client_code", "-1") if is_client else "0"),
"code_fournisseur": (d.get("supplier_code", "-1") if is_supp else "0"),
}
for k in ("siret", "tva_intra", "address", "zip", "town", "email", "phone", "idprof1"):
if d.get(k):
body[k] = d[k]
# Line 1: POST body. Line 2: the dedupe lookup path (exact name, promote-apply
# `#thirdparty:name=` semantics — SQL-escape ' by doubling, then URL-encode).
print(json.dumps(body))
flt = "(t.nom:=:'%s')" % str(d["name"]).replace("'", "''")
print("/thirdparties?limit=2&sqlfilters=" + urllib.parse.quote(flt))
PY
MAPPED="$(printf '%s' "${INPUT}" | python3 "${TMPD}/map.py")"
BODY="$(sed -n 1p <<<"${MAPPED}")"
LOOKUP="$(sed -n 2p <<<"${MAPPED}")"
printf '%s' "${BODY}" > "${TMPD}/body.json"
# --- 2. Dedupe by exact name against the target (erp#44) -----------------------
set +e
"${W}" GET "${LOOKUP}" > "${TMPD}/list.json" 2> "${TMPD}/list.err"
rc=$?
set -e
if [[ ${rc} -ne 0 ]]; then
if grep -q "HTTP 404" "${TMPD}/list.err"; then
printf '[]' > "${TMPD}/list.json" # no-match answers 404, not [] (dolibarr skill gotcha)
else
cat "${TMPD}/list.err" >&2
echo "thirdparty-create.sh: could not look up name on the target — refusing to POST blind (dedupe impossible)" >&2
exit 1
fi
fi
cat > "${TMPD}/match.py" <<'PY'
import json, sys
body = json.load(open(sys.argv[1]))
try:
rows = json.load(open(sys.argv[2]))
except Exception:
rows = []
rows = rows if isinstance(rows, list) else []
if len(rows) > 1:
sys.exit("thirdparty-create.sh: ABORT — name %r matches %d thirdparties on the "
"target (ids %s); ambiguous, refusing to guess (same rule as the "
"promote '#thirdparty:name=' lookup)"
% (body["name"], len(rows), ", ".join(str(r.get("id")) for r in rows)))
if rows:
r = rows[0]
want_client = body["client"] == "1"
want_supp = body["fournisseur"] == "1"
# Dolibarr: client '1'=customer '2'=prospect '3'=both; fournisseur '1'=yes.
has_client = str(r.get("client") or "0") in ("1", "2", "3")
has_supp = str(r.get("fournisseur") or "0") == "1"
missing = []
if want_client and not has_client: missing.append("client")
if want_supp and not has_supp: missing.append("supplier")
if missing:
sys.exit("thirdparty-create.sh: ABORT — %r already exists (id %s) but "
"without the requested role(s): %s. Refusing to dedupe onto a "
"fiche that can't carry the ops that follow, and refusing to "
"mutate its roles as a create side effect — fix the fiche "
"deliberately first." % (body["name"], r.get("id"), ", ".join(missing)))
print(json.dumps({"id": int(r["id"]), "deduped": True}))
PY
MATCH="$(python3 "${TMPD}/match.py" "${TMPD}/body.json" "${TMPD}/list.json")"
if [[ -n "${MATCH}" ]]; then
echo "thirdparty-create.sh: thirdparty already exists — deduped, no POST" >&2
printf '%s\n' "${MATCH}"
exit 0
fi
# --- 3. POST the new thirdparty -------------------------------------------------
NEWID="$("${W}" POST /thirdparties "${BODY}")"
if [[ ! "${NEWID}" =~ ^[0-9]+$ ]]; then
echo "thirdparty-create.sh: create did not return an id: ${NEWID}" >&2
exit 1
fi
printf '{"id": %s, "deduped": false}\n' "${NEWID}"