MEGAINFRA-WEBAPP/scripts/pb-enable-batch-api.py
DEls 252dd7eb6a fix(dn): let staged ingestion run against the real PocketBase schema
Three faults stopped the staged pipeline from ingesting anything once it
met a live PocketBase rather than a test double.

PocketBase treats 0 as blank for a required number field, and two staged
fields legitimately hold zero: dn_batch_sources.ordinal is 0 for the
first source in a batch, and dn_batch_pages.region is 0 for a whole-page
read. Both creates were rejected with validation_required, so the first
file of every upload failed and no page ever persisted. The migration now
declares them optional, and pb-relax-dn-zero-fields.py relaxes instances
that already have them required.

The staged runner verifies its batch lease and commits the protected
write in one transaction, which needs PocketBase's batch API. That is off
by default, so the runner failed closed with
dn_pipeline_transactions_required and no deployment note explained why.
pb-enable-batch-api.py turns it on and raises the 3s transaction timeout,
which is tight for a commit carrying page images.

compare-dn-pipelines used top-level await while resolving as CJS, so the
command in the rollout runbook always failed to transform. Renamed .mts.

The tests missed all of this because they mock PocketBase, and the mock
accepts what the real server rejects.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 23:49:58 +02:00

73 lines
2.4 KiB
Python

#!/usr/bin/env python3
"""Enable PocketBase's transactional batch API.
The staged delivery-note pipeline verifies its batch lease and commits the
protected business write inside one transaction, which requires this endpoint.
With it disabled the runner fails closed with
``dn_pipeline_transactions_required``.
The default 3s transaction timeout is raised because a staged batch commits
page images alongside its metadata.
Dry run unless ``--apply`` is supplied, and ``--apply`` additionally requires
``--confirm-host`` matching the configured PocketBase host exactly.
"""
import sys
from pb_env import PB, http, superuser_token
WANT_TIMEOUT = 30
APPLY = "--apply" in sys.argv
def confirmation_host():
for index, argument in enumerate(sys.argv):
if argument.startswith("--confirm-host="):
return argument.split("=", 1)[1]
if argument == "--confirm-host" and index + 1 < len(sys.argv):
return sys.argv[index + 1]
return None
def main():
if APPLY and confirmation_host() != PB:
sys.exit(
f"REFUSING --apply: pass --confirm-host with the exact configured "
f"host ({PB})."
)
token = superuser_token()
print(f"auth ok on {PB}")
print(f"target: {PB} mode: {'APPLY' if APPLY else 'DRY RUN'}")
code, settings = http("GET", "/api/settings", token=token)
if code != 200:
sys.exit(f"could not read settings ({code})")
batch = dict(settings.get("batch") or {})
print(f" current: enabled={batch.get('enabled')} timeout={batch.get('timeout')} maxRequests={batch.get('maxRequests')}")
desired = dict(batch)
desired["enabled"] = True
if int(batch.get("timeout") or 0) < WANT_TIMEOUT:
desired["timeout"] = WANT_TIMEOUT
if desired == batch:
print(" already configured; nothing to do")
return
if not APPLY:
print(f" would set: enabled={desired['enabled']} timeout={desired['timeout']} maxRequests={desired.get('maxRequests')}")
print("\nDRY RUN. No settings written.")
return
code, response = http("PATCH", "/api/settings", {"batch": desired}, token=token)
if code != 200:
sys.exit(f" PATCH failed {code}: {response}")
applied = (response or {}).get("batch", desired)
print(f" applied: enabled={applied.get('enabled')} timeout={applied.get('timeout')} maxRequests={applied.get('maxRequests')}")
print("\nAPPLIED.")
main()