web-scraper-api

web-scraper-api is a skill for Claude Code, Codex from oxylabs/agent-skills. It costs 72 tokens per session (1,508 once invoked), scanned A, original, MIT.

A web-scraping API that collects pages and returns data, including structured results for supported shopping and search websites.

In plain words
What is it for?
Use it to scrape web pages, product information, search results, and other supported targets, with optional structured parsing, browser rendering, geographic targeting, and repeated sessions.
Why use it?
It reduces the work of handling different website formats, JavaScript-rendered pages, location-specific results, and anti-bot protections yourself.

Skill for Claude CodeCodex

Part of the agent-skills plugin — 5 skills shipped together

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/oxylabs/agent-skills/web-scraper-api
Any agent
npx skills add oxylabs/agent-skills --skill web-scraper-api
Clone the repo
git clone --depth 1 https://github.com/oxylabs/agent-skills

Made for: Claude Code, Codex.

Or install agent-skills, the plugin that ships this one along with the rest of its 5 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for web-scraper-api

README.md
[![agentmods](https://agentmods.dev/badge/skills/oxylabs/agent-skills/web-scraper-api.svg)](https://agentmods.dev/skills/oxylabs/agent-skills/web-scraper-api)
Your own site
<a href="https://agentmods.dev/skills/oxylabs/agent-skills/web-scraper-api"><img src="https://agentmods.dev/badge/skills/oxylabs/agent-skills/web-scraper-api.svg" alt="Measured on agentmods" height="20"></a>
Per session 72 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,508 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00072 $0.01508
Opus 5 $0.00036 $0.00754
Sonnet 5 $0.00014 $0.00302
Haiku 4.5 $0.00007 $0.00151

Measured 5d ago against content hash 569ecb2cd71f, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

web-scraper-api scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" ...
skills/web-scraper-api/SKILL.md · 136 lines

How it starts

The opening of the file, as written. The whole thing — 136 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Oxylabs Web Scraper API

Authentication

Requires HTTP Basic Auth with credentials from environment variables:

curl -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" ...

Endpoint

POST https://realtime.oxylabs.io/v1/queries   # immediate response
POST https://data.oxylabs.io/v1/queries       # Push-Pull jobs, callbacks, storage
Content-Type: application/json

Core Parameters

Parameter Required Description
source Yes Target scraper (e.g., universal, amazon_product, google_search)
url Conditional URL to scrape (for universal and *_url sources)
query Conditional Search query or product ID (for *_search and *_product sources)
parse No Enable structured data parsing (recommended for supported sources)
render No JavaScript rendering: html or png
geo_location No Geographic targeting: country/state/city, ZIP/postcode, coordinates, or Criteria ID where supported
session_id No Reuse the same proxy IP across multiple jobs
content_encoding No Set to base64 when downloading image files via Realtime or Push-Pull
user_agent_type No Device/browser preset, e.g., desktop_chrome, mobile_ios, tablet_android
locale No Interface language / Accept-Language, e.g., de-DE
callback_url No Push-Pull callback endpoint
storage_type, storage_url No Push-Pull cloud upload target (gcs, s3, tos, s3_compatible)
markdown, xhr No Enable markdown or captured XHR result types
browser_instructions No Rendered browser actions; requires render: "html"
parsing_instructions, parser_preset No Custom parser rules or saved preset; pair with parse: true
client_notes No Client-side job tag saved with the job metadata
domain, subdomain, start_page, pages, limit, store_id, delivery_zip, fulfillment_type Source-specific Marketplace/search/store localization and pagination fields

Read the full file on GitHub · 136 lines

Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 5d ago First seen · 136 lines · 72 tokens per session scan A 569ecb2cd71f

Subscribe to this mod's changes

web-scraper-api is a skill published in the GitHub repository oxylabs/agent-skills (871 stars, last pushed 14d ago), licensed MIT. It adds 72 tokens to every session and 1,508 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

skill-xhs-comment-reply

小红书评论互动运营:列出我的笔记、抓取某条笔记下的评论、按画像语气逐条回复、以及删除评论 (含自己发的回复)。基于 Playwright + 持久化登录态,headless 即可运行,与 skill-xhs-publisher 共用同一登录态。评论抓取走接口响应拦截(稳);回复/删除走 DOM 文本定位(无坐标)+ 逐字符输入反检测; 带已回复去重、逐条间隔防风控、dry-run 预演。用 notes 列笔记或 fetch --url 贴链接,免手动拆 token。 触发:抓小红书评论 / 回复评论 / 删除评论 / 删评 / 维护评论区 / 看我某条笔记的评论。.

ZJU-REAL/Easel · 186 tokens

skill-zhihu-answer

知乎问答回答发布:在知乎问题下发布原创回答——搜热门问题、检查可答性、写内容、 Playwright 发布(绕 header 遮挡 + JS 遍历发布按钮)。当用户说"回答知乎问题""在知乎问答下回答" "发知乎回答""知乎答题""帮我回答这个知乎问题""批量回答知乎"时使用。与 skill-zhihu-publisher 区别:那个发专栏文章(zhuanlan),本 SKILL 专发问答区的回答;回答内容写作用制作层 SKILL (novel-writer / copywriting)。.

ZJU-REAL/Easel · 142 tokens

skill-douyin-upload

将视频/图文内容发布到抖音(creator.douyin.com)。基于 Playwright + 持久化登录态,headless 即可运行, 流程与选择器移植自开源实现 douyin-upload-mcp-skill(含高清发布入口、切 tab、上传等转码、AI 封面、 发布成功 toast 校验、二维码登录)。适用场景:发布抖音视频、发布图文、扫码登录、发布前预检。.

ZJU-REAL/Easel · 110 tokens

skill-xhs-publisher

将图文/视频内容发布到小红书(XHS)。基于 Playwright + 持久化登录态,headless 即可运行, 流程与选择器移植自成熟开源实现 xiaohongshu-mcp(含发布成功校验、上传完成等待、话题联想绑定、 新旧发布按钮兼容、反检测)。适用场景:发布图文笔记、发布视频、扫码登录、发布前预检。.

ZJU-REAL/Easel · 106 tokens

skill-kuaishou-upload

快手视频发布:把竖版短视频发布到快手创作者中心。当用户说"发快手""上传快手""快手投稿" "发布到快手""快手视频发布"时使用。基于通用浏览器发布框架(Playwright + 登录态持久化)。.

ZJU-REAL/Easel · 74 tokens

skill-channels-upload

微信视频号发布:把竖版短视频发布到微信视频号(channels.weixin.qq.com)。当用户说 "发视频号""上传视频号""视频号发布""发到微信视频号""视频号投稿"时使用。基于通用浏览器 发布框架(Playwright + 登录态持久化),微信扫码登录。.

ZJU-REAL/Easel · 79 tokens