David/MEGAINFRA-WEBAPP
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
MEGAINFRA-WEBAPP/scripts/site-model
History
DEls cb4a1ce461 feat(site-map): Maps page with previews, double-click progress popup, Cedar Gate cut & fill 
- Sites → Maps in the sidebar replaces the per-site Site map / Map 2 links.
  The Maps page shows each site's model as a plan preview (built sections
  solid) with % of road layerworks built and links to Site map and Map 2.
- Double-clicking a road section opens its progress tick-boxes over the map
  (Site map saves to the server; Map 2 stays a local scenario).
- Cedar Gate: 40 drawn cross-sections extracted from C3277-912-001 Rev A
  (extract_cedar_gate_xs.py), cut/fill limited to Cedar Gate Road, a Cut &
  fill workspace in Map 2 with a chainage chart, and pavement layers shown
  in their material colours.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 12:55:51 +02:00
..
alignment.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
dxf_reader.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
extract_bushveld.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
extract_cedar_gate.py feat: update management comparisons and Cedar Gate site model 2026-10-20 12:23:44 +02:00
extract_cedar_gate_xs.py feat(site-map): Maps page with previews, double-click progress popup, Cedar Gate cut & fill 2026-10-20 12:55:51 +02:00
extract_extras.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
extract_surface.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
extract_xs.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
model_keys.py feat(site-map): model upload script with progress-key parity 2026-10-14 07:06:13 +02:00
README.md feat: update management comparisons and Cedar Gate site model 2026-10-20 12:23:44 +02:00
test_alignment.py feat(site-map): model pipeline with 20 m chainage sections 2026-10-14 07:04:34 +02:00
test_model_keys.py feat(site-map): model upload script with progress-key parity 2026-10-14 07:06:13 +02:00
test_upload.py feat(site-map): model upload script with progress-key parity 2026-10-14 07:06:13 +02:00
upload.py feat: update management comparisons and Cedar Gate site model 2026-10-20 12:23:44 +02:00

README.md

Site model pipeline (Phase 1, run by hand)

Turns a consultant's drawings into the five JSON files the Site map page loads (bushveld.json, services.json, earthworks.json, schedules.json, surface.json). Specific to Civil Concepts' layer names on Bushveld Joy Road (C3092); other drawing sets need the layer maps at the top of each script adjusted.

Tools

  • LibreDWG (brew install libredwg) → dwg2dxf
  • poppler (brew install poppler) → pdftotext, pdftocairo
  • Python 3 with numpy

Build (Bushveld Joy example)

  1. Convert DWGs: dwg2dxf -y -o out.dxf in.dwg (road layout M910-001, signs & markings M910-002, studs M910-005, stormwater LS M921-001).
  2. Run in this order, all writing into one output folder OUT: 
    python3 -I extract_bushveld.py <road-layout.dxf> "<SO DATA folder>" OUT/bushveld.json
python3 -I extract_extras.py <drawings folder> <converted DXF folder> OUT
python3 -I extract_surface.py <road-layout.dxf> OUT
python3 -I extract_xs.py <cross-section.pdf> <road-layout.dxf> OUT
    (extract_xs.py validates against surface.json, so run it last.)
  3. Upload: python3 upload.py --site <site id> --label "<text>" [--dry-run] OUT.

Checks printed by the scripts

  • extract_bushveld: areas per work type and the 20 m chainage sections.
  • extract_surface: contour-only surface vs peg levels (median / 90th percentile).
  • extract_xs: rebuilt alignment length vs the drawing (674.412 m for Bushveld Joy) and cross-section vs design-surface agreement.
  • upload: progress keys recorded on the site that the new model no longer has.

Tests

python3 -m unittest discover -s scripts/site-model -p "test_*.py"

Cedar Gate (C3277 / Equestria Ext. 289)

The 2026-10-20 delivery contains two projects. Use the C3277 archive and Cedar Gate Contours Chris.dwg; exclude the Nellmapius drawings.

  1. Convert the bound C3277-910-001 Rev A road layout, C3277-920to940 Rev B services layout, and Chris ground-contour DWG to DXF with dwg2dxf.
  2. With Python packages numpy scipy shapely>=2.1 ezdxf available, run: 
    python3 scripts/site-model/extract_cedar_gate.py DXF_FOLDER OUTPUT_FOLDER
  3. Check validation.json, the source hashes in sources.json, surface coverage, and the rendered model. The initial reviewed output is in reports/site-models/cedar-gate/2026-10-20.
  4. Upload with the normal uploader using Cedar Gate site ID u6n5fye4czinw6o.

The extractor checks all four alignment lengths against drawing labels, conserves hatch areas in disjoint 20 m planning sections, measures single kerb lines once, and keeps surveyed ground separate from the finished-level surface. Service routes are plan overlays without inferred inverts, pipe sizes or trench volumes. External lower pavement layers, earthwork volumes and setting-out pegs are deliberately unquantified pending reconciliation with the relevant source data.