What is scraperapi-agent-onboarding?

An introductory guide to ScraperAPI, a service that gives programs and agents access to web pages and structured data. It explains API-key setup and how to choose between direct requests, crawling, background jobs, scheduled pipelines, and other ScraperAPI tools.

Use it to set up ScraperAPI, connect it to an agent or application, fetch HTML or markdown, access supported structured data, or decide which ScraperAPI product fits a scraping task.

It gives newcomers a starting point before they choose a more specialized integration. It also explains how to verify access and keep the API key out of code and configuration shared with others.

scraperapi-agent-onboarding — Skill by scraperapi

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods

npx agentmods add skills/scraperapi/scraperapi-skills/scraperapi-agent-onboarding

Any agent

npx skills add scraperapi/scraperapi-skills --skill scraperapi-agent-onboarding

Clone the repo

git clone --depth 1 https://github.com/scraperapi/scraperapi-skills

Made for: Claude Code, Codex.

Per session 162 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.

When invoked 2,348 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 1 finding. Scan, not verified.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5	$0.00162	$0.02348
Opus 5	$0.00081	$0.01174
Sonnet 5	$0.00032	$0.00470
Haiku 4.5	$0.00016	$0.00235

Measured 2d ago against content hash 70f8e292c270, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

scraperapi-agent-onboarding scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl "https://api.scraperapi.com/?api_key=$SCRAPERAPI_API_KEY&url=https://httpbin.org/ip"

skills/scraperapi-agent-onboarding/SKILL.md · 264 lines

How it starts

The opening of the file, as written. The whole thing — 264 lines — stays where its author put it; the contents beside it link to each section on GitHub.

ScraperAPI — Agent Onboarding

ScraperAPI gives agents and apps reliable access to web data: any URL returned as clean HTML or markdown (with proxy rotation, CAPTCHA bypass, and JS rendering handled automatically), structured JSON from 20+ supported platforms (Amazon, Walmart, eBay, Redfin, Google SERP), and a crawler for multi-page extraction.

This skill is the entry point. Read it once, pick a path, then hand off to the narrower skill that owns that path.

Getting an API key

All paths require a ScraperAPI key. If you don't have one:

Sign up at https://www.scraperapi.com/ — free trial includes 5,000 credits
Copy your key from https://dashboard.scraperapi.com/
Set it in your environment — never hardcode it in code or configs:

# macOS / Linux
export SCRAPERAPI_API_KEY=<your-key>

# Windows PowerShell
$env:SCRAPERAPI_API_KEY = "<your-key>"

# .env file
SCRAPERAPI_API_KEY=...

Verify the key works before doing real work:

curl "https://api.scraperapi.com/?api_key=$SCRAPERAPI_API_KEY&url=https://httpbin.org/ip"

A JSON response with an origin IP confirms the key is valid. A 401 means the key is wrong or inactive — do not retry with the same key, surface the error.

Choose your path

Situation	Path
LLM agent needs web data during this session	Path A — MCP Server
Adding ScraperAPI to app code	Path B — SDK / REST integration
Quick request, or environment without Node/Python	Path C — REST API directly
Need an API key first	Path D — Auth only (above)

If your task spans paths, do them in order: get key → MCP or SDK → test one real request before building.

Path A — MCP Server (LLM tool layer)

Use this when the consumer is an LLM agent (Claude Code, custom agent loop) that should call ScraperAPI as tools. The MCP server exposes up to 22 tools — scrape, Google, Amazon, Walmart, eBay, Redfin, and crawler — over a single connection.

Remote server (recommended)

Read the full file on GitHub · 264 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

2d ago First seen · 264 lines · 162 tokens per session scan A 70f8e292c270

Subscribe to this mod's changes

scraperapi-agent-onboarding is a skill published in the GitHub repository scraperapi/scraperapi-skills (10 stars, last pushed 25d ago), licensed MIT. It adds 162 tokens to every session and 2,348 once invoked, about $0.0008 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Backend and APIs Browser automation Data and AI LLM agent-skills ai claude-skills mcp-server scraping

scrapling-official

Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…

D4Vinci/Scrapling · 80 tokens

scraperapi-agent-onboarding