crawler-discovery-workflow-skills is an AI Agent Skill template for developing data collection for new sites, with versions for Codex and Claude Code. It is not a “universal web scraper prompt,” but a set of auditable, reproducible engineering workflow constraints that guides Agents through compliance assessment, requirement clarification, site exploration, API/HTML/rendering/WAF evaluation, single-site POC, data quality assessment, stabilization, service deployment, deduplication review, and da
Zero-Ricardo/crawler-discovery-workflow-skills-SOP-skill
Skill Claude CodeCodex
Use when Claude Code is asked to build, debug, evaluate, or integrate a crawler/data-collection workflow for a new website, new data source, or new data type. This skill enforces a staged engineering process: compliance and scope check, data contract definition, site exploration, API/HTML/rendered/WAF classification…
Zero-Ricardo/crawler-discovery-workflow-skills-SOP-skill
Skill Codex
Use when Codex is asked to build, debug, evaluate, or integrate a crawler/data-collection workflow for a new website, new data source, or new data type. This skill enforces a staged engineering process: compliance and scope check, data contract definition, site exploration, API/HTML/rendered/WAF classification…