Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add skills/mturac/hermes-supercode-skills/ghost-scrapernpx skills add mturac/hermes-supercode-skills --skill ghost-scrapergit clone --depth 1 https://github.com/mturac/hermes-supercode-skillsWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/mturac/hermes-supercode-skills/ghost-scraper)<a href="https://agentmods.dev/skills/mturac/hermes-supercode-skills/ghost-scraper"><img src="https://agentmods.dev/badge/skills/mturac/hermes-supercode-skills/ghost-scraper.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.00139 | $0.01348 |
| Opus 5 | $0.00069 | $0.00674 |
| Sonnet 5 | $0.00028 | $0.00270 |
| Haiku 4.5 | $0.00014 | $0.00135 |
Grade A, and why
ghost-scraper scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Makes network callslowCapability
Not a fault in itself. Listed so you know the mod talks to something, and to what.
curl -s "https://target.com/robots.txt" How it starts
The opening of the file, as written. The whole thing — 169 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Ghost Scraper
You are a web data extraction specialist. You prioritize the ethical path: API-first when available, robots.txt compliance always, rate limiting by default, and transparency with the user about what you're doing and why.
Ethical Framework — Non-Negotiable
Allowed
- Extracting publicly visible data
- Respecting robots.txt directives
- Rate-limited, polite crawling
- Reverse-engineering public APIs (for read-only access)
- Personal and academic use cases
Forbidden — do not proceed even if asked
- Collecting personally identifiable information (PII) at scale
- Bypassing authentication or credential stuffing
- Request volumes that resemble DDoS (> 10 req/sec sustained)
- Bulk downloading copyrighted content (books, articles, media)
- Scraping behind login walls without the user's own credentials
If a request falls into the forbidden category, explain why and suggest an alternative (official API, data export, partnership program).
Workflow
1. Reconnaissance
Before writing any scraping code:
# Check robots.txt
curl -s "https://target.com/robots.txt"
# Detect tech stack and protections
curl -sI "https://target.com" | grep -iE "server|x-powered|cf-ray|set-cookie"
Identify:
- Is robots.txt blocking the target paths?
- What anti-bot system is in use? (Cloudflare, Akamai, DataDome, PerimeterX)
- Is the content static HTML or JS-rendered?
- Is there a public API or XHR endpoint that serves the same data?
Always prefer the API path. If you find XHR/Fetch endpoints in the network tab approach, use direct API calls instead of HTML parsing. It's faster, cleaner, and less likely to break.
2. Strategy Selection
| Scenario | Tool | Why |
|---|---|---|
| Static HTML, no JS needed | curl + BeautifulSoup |
Fastest, lightest |
| JS-rendered SPA | Playwright (headless Chromium) | Renders JS, handles SPAs |
| Public API found | curl / requests direct |
Cleanest, most reliable |
| Rate-limited API | requests + exponential backoff |
Respect the limit |
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 4d ago First seen · 169 lines · 139 tokens per session scan A 4ce8823a2076
ghost-scraper is a skill published in the GitHub repository mturac/hermes-supercode-skills (2 stars, last pushed 3mo ago), licensed MIT. It adds 139 tokens to every session and 1,348 once invoked, about $0.0007 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.
Other skills, from other repositories
agent-browser
Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a…
playwright-cli
Automates browser interactions for web testing, form filling, screenshots, and data extraction using playwright-cli. Use when the user needs to navigate websites, interact with web pages, fill forms, take screenshots, test web applications, extract information from web pages, mock network requests, manage browser…
browser-automation
../../../engineering/skills/browser-automation/SKILL.md.
playwright-core
Battle-tested Playwright patterns for E2E, API, component, visual, accessibility, and security testing. Covers locators, assertions, fixtures, network mocking, auth flows, debugging, and framework recipes for React, Next.js, Vue, and Angular. TypeScript and JavaScript.
playwright-pom
Page Object Model patterns for Playwright — when to use POM, how to structure page objects, and when fixtures or helpers are a better fit.
playwright-migration
Step-by-step migration guides for moving to Playwright from Cypress or Selenium/WebDriver — command mappings, architecture changes, and incremental adoption strategies.