SHEET 35 · Terrain & GIS
County Data Scraper
Playwright pipeline scraping 716 county portals across 30 parallel browser tabs with month-by-month CSV downloads back to 1970
no public build · runs locally
2024localTerrain & GIS
About
A three-phase pipeline that catalogs 716 US counties from Beacon/Schneider Corp, classifies each portal's site architecture, and downloads month-by-month sales CSVs going back to 1970. Runs headed Chromium in a virtual framebuffer (xvfb) to bypass anti-bot measures, supports up to 30 parallel browser tabs, auto-splits date ranges at the 500-record cap, and includes checkpoint/resume for interrupted runs with a live terminal dashboard.
Key features
- 01Three-phase pipeline: extraction, classification, downloading
- 02Concurrent browser workers (up to 30 tabs in parallel)
- 03Checkpoint/resume system for long-running scrapes
- 04Live terminal dashboard with progress bars
- 05Automatic month-splitting for capped result sets
- 06Headed Chromium in virtual framebuffer for anti-bot bypass
- 07Single-county, date-range, and retry-failed modes
- 08Structured logging with timestamped log files
Nearby
SHEET 09 · Terrain & GIS
Mountain Models
8,000 ski resorts worldwide, one DEM pipeline — watertight multicolor STLs and seamless height-tile bundles for a real-time terrain engine
2026live8,000 resorts2 output targets
SHEET 10 · Terrain & GIS
xyzski
A 3D ski mountain you can drop into any website with one line of code
2026live207 kb embed60 resorts baked
SHEET 11 · Terrain & GIS
Datum
Colorado's 57 fourteeners as 3D-printed, magnet-mounted relief tiles — one DEM-to-mesh pipeline and the storefront that sells them
2025local57 fourteeners