Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add liortesta/ClawdAgent --skill web-scraping-recongit clone --depth 1 https://github.com/liortesta/ClawdAgentWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/liortesta/clawdagent/web-scraping-recon)<a href="https://agentmods.dev/skills/liortesta/clawdagent/web-scraping-recon"><img src="https://agentmods.dev/badge/skills/liortesta/clawdagent/web-scraping-recon/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/liortesta/clawdagent/web-scraping-recon"><img src="https://agentmods.dev/badge/skills/liortesta/clawdagent/web-scraping-recon.svg" alt="Reviewed on agentmods" width="80" height="20"></a>- NVIDIA SkillSpector pass
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00000 | $0.00732 |
| Opus 5 | $0.00000 | $0.00366 |
| Sonnet 5 | $0.00000 | $0.00146 |
| Haiku 4.5 | $0.00000 | $0.00073 |
Grade A, and why
web-scraping-recon scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Makes network callslowCapability
Not a fault in itself. Listed so you know the mod talks to something, and to what.
robots = await fetch(f"{target_url}/robots.txt") How it starts
The opening of the file, as written. The whole thing — 73 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Web Scraping & Data Extraction — WebExtractor
For authorized security testing and reconnaissance only.
Overview
WebExtractor is a web scraping and data extraction tool used during authorized security assessments to identify exposed information on websites. It extracts emails, phone numbers, links, metadata, and other structured data from web pages.
Core Capabilities
- Email Harvesting: Extract email addresses from target websites and linked pages
- Phone Number Extraction: Find phone numbers with regex patterns across pages
- Link Mapping: Crawl and map all internal/external links, identify hidden endpoints
- Form Detection: Find login forms, file uploads, and input fields (potential attack vectors)
- Comment Extraction: Find HTML comments that may contain sensitive info (API keys, TODOs, debug info)
- JavaScript Analysis: Extract API endpoints, tokens, and secrets from JS files
- Metadata Harvesting: Extract document metadata (author, creation date, software used)
Security Testing Applications
Reconnaissance Phase
Target Website → WebExtractor
├── Emails found → Check against breach databases
├── Phone numbers → Social engineering risk assessment
├── Hidden links → Discover admin panels, dev endpoints
├── JS files → Extract hardcoded API keys/secrets
├── HTML comments → Find debug info, internal notes
├── Forms → Map input validation points
└── Documents → Extract metadata (author info, tools used)
Common Findings in Security Audits
- Exposed Emails: Employee emails in page source → phishing risk
- Hardcoded Secrets: API keys in JavaScript bundles
- Admin Panels: Hidden /admin, /dashboard, /wp-admin endpoints
- Debug Information: Stack traces, version numbers in comments
- Document Metadata: Author names, internal paths, software versions
- Unprotected API Endpoints: REST/GraphQL endpoints in JS
Techniques
- Crawling: Recursive page discovery with depth limits
- Regex Extraction: Pattern matching for emails, phones, IPs, secrets
- DOM Parsing: BeautifulSoup, Cheerio, Puppeteer for structured extraction
- Header Analysis: Server headers, security headers (CSP, HSTS, X-Frame-Options)
- robots.txt / sitemap.xml: Find hidden paths and disallowed directories
- Archive.org Wayback Machine: Historical snapshots for removed but cached content
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 7d ago First seen · 73 lines · 0 tokens per session scan A a15628272e6c
web-scraping-recon is a skill published in the GitHub repository liortesta/ClawdAgent (11 stars, last pushed 14d ago), licensed Apache-2.0. It costs nothing until one of its globs matches a file; then it loads 732 tokens. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.
Other skills, from other repositories
opencli-sitemap-author
Use when creating or maintaining OpenCLI site sitemaps: agent-facing navigation, page-state, action, workflow, API-reference, pitfall, and fallback knowledge for a website. Use after browser exploration discovers durable site context, when a sitemap is stale, or when promoting local site knowledge into the repo.
debug-optimize-lcp
Guides debugging and optimizing Largest Contentful Paint (LCP) using Chrome DevTools MCP tools. Use this skill whenever the user asks about LCP performance, slow page loads, Core Web Vitals optimization, or wants to understand why their page's main content takes too long to appear. Also use when the user mentions…
interactive-login
How to complete browser/interactive logins (aws / gh / glab / gcloud). The platform backgrounds the login poller so it survives the human's browser round-trip — and when that does NOT work.
pinchtab-mcp
Use this skill when a task requires browser automation through PinchTab's MCP server connected to a remote browser instance. Covers navigation, element interaction, data extraction, form filling, multi-step flows, and session management via MCP tools.
azure-messaging-webpubsub-java
Build real-time web applications with Azure Web PubSub SDK for Java. Use when implementing WebSocket-based messaging, live updates, chat applications, or server-to-client push notifications.
google-safe-browsing
Prevent and fix Google Safe Browsing "Dangerous site" flags. Use when launching a public web app, buying/picking a domain, building a login or signup page, or when any site shows a red "Dangerous site" / "Deceptive site" warning in Chrome, Brave, Safari, Firefox, or Edge. Triggers on "dangerous site", "deceptive…