web-scraping

web-scraping is a skill for Claude Code, Codex from ginlix-ai/LangAlpha. It costs 51 tokens per session (2,191 once invoked), scanned A, original, Apache-2.0.

A set of tools for downloading web pages as Markdown, HTML, or text, including pages that need a browser to run JavaScript. It also provides a Python API for selecting page elements, managing sessions, logging in, and crawling multiple pages.

In plain words
What is it for?
Collecting information from one page or many URLs, extracting selected fields with CSS or XPath, handling logged-in sessions, and building multi-page crawlers in Python.
Why use it?
It removes much of the custom work needed to fetch ordinary and bot-protected websites. You can choose a fast HTTP request, browser rendering, or stealth fetching depending on the site.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Collecting information from one page or many URLs, extracting selected fields with CSS or XPath, handling logged-in sessions, and building multi-page crawlers in Python.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/ginlix-ai/langalpha/web-scraping
About the project

LangAlpha is an agent workspace for researching financial markets and supporting investment decisions through persistent research, news analysis, and parallel subagents. It is for investors who want to develop and update trading theses over time, including generating long-short pair-trade ideas. The catalogue entries provide the skills, instructions, MCP servers, and plugin that make up its agent workflow.

ginlix-ai/LangAlpha · 1,726 stars · on GitHub · langalpha.ai

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add ginlix-ai/LangAlpha --skill web-scraping
Clone the repo
git clone --depth 1 https://github.com/ginlix-ai/LangAlpha

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for web-scraping

README.md
[![agentmods](https://agentmods.dev/badge/skills/ginlix-ai/langalpha/web-scraping.svg)](https://agentmods.dev/skills/ginlix-ai/langalpha/web-scraping)
Your own site
<a href="https://agentmods.dev/skills/ginlix-ai/langalpha/web-scraping"><img src="https://agentmods.dev/badge/skills/ginlix-ai/langalpha/web-scraping.svg" alt="Measured on agentmods" height="20"></a>
Per session 51 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,191 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00051 $0.02191
Opus 5 $0.00026 $0.01095
Sonnet 5 $0.00010 $0.00438
Haiku 4.5 $0.00005 $0.00219

Measured 5d ago against content hash 9b3863eab657, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade A, and why

web-scraping scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/alternative_data/skills/web-scraping/SKILL.md · 258 lines

How it starts

The opening of the file, as written. The whole thing — 258 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Web Scraping

Overview

Two ways to scrape in the sandbox:

  1. MCP tools (scrape_page, scrape_pages) — recommended for straight "give me this page's content". Synchronous, return dicts.
  2. Direct Scrapling Python API — for CSS/XPath selectors, sessions, logins, and multi-page spiders. Async, returns Page objects with .css() / .xpath().

Quick fetches can run inline via ExecuteCode. For spiders, multi-URL crawls, or anything you'll iterate on, write the scraper to work/<task_name>/scraper.py and run it via Bash — edit-and-rerun beats resubmitting code.

MCP Tools

Import from tools.scrape. Synchronous — no await.

from tools.scrape import scrape_page, scrape_pages

Signatures

scrape_page(url: str, mode: str = "fast", extraction: str = "markdown",
            timeout: float = 30.0, solve_cloudflare: bool = False) -> dict

scrape_pages(urls: list[str], mode: str = "fast", extraction: str = "markdown",
             timeout: float = 30.0, solve_cloudflare: bool = False) -> dict

Parameters

Param Default Notes
mode "fast" "fast" plain HTTP · "browser" JS rendering · "stealth" bot-protected sites
extraction "markdown" "markdown" (article text, cleaned) · "html" (raw) · "text" (plain)
timeout 30.0 Per-fetch seconds, 1–60 — seconds in every mode, not ms
solve_cloudflare False Only meaningful with mode="stealth"
urls scrape_pages only; max 10 per call

Escalate modes only as needed: start fast, go to browser when the page needs JavaScript, stealth when you're getting blocked, and add solve_cloudflare=True only if stealth still returns a challenge page.

Return shape

scrape_page returns a flat dict:

{
    "url": "https://example.com",
    "status": 200,
    "title": "Example Domain",
    "content": "# Example Domain\n\nThis domain is for use in...",  # str
    "extraction": "markdown",
    "mode": "fast",
}

Read the full file on GitHub · 258 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 5d ago Changed 9b3863eab657
  2. 8d ago First seen · 258 lines · 51 tokens per session scan A 237c6009b5e0

Subscribe to this mod's changes

web-scraping is a skill published in the GitHub repository ginlix-ai/LangAlpha (1,726 stars, last pushed yesterday), licensed Apache-2.0. It adds 51 tokens to every session and 2,191 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

pdf

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents, and handling forms. When Claude needs to fill in a PDF form or programmatically process, generate, or analyze PDF documents at scale.

Chen-zexi/open-ptc-agent · 50 tokens

xlsx

Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and visualization. When Claude needs to work with spreadsheets (.xlsx, .xlsm, .csv, .tsv, etc) for: (1) Creating new spreadsheets with formulas and formatting, (2) Reading or analyzing data, (3) Modify…

Chen-zexi/open-ptc-agent · 96 tokens

pptx

Presentation creation, editing, and analysis. When Claude needs to work with presentations (.pptx files) for: (1) Creating new presentations, (2) Modifying or editing content, (3) Working with layouts, (4) Adding comments or speaker notes, or any other presentation tasks.

Chen-zexi/open-ptc-agent · 62 tokens

creating-financial-models

This skill provides an advanced financial modeling suite with DCF analysis, sensitivity testing, Monte Carlo simulations, and scenario planning for investment decisions.

Chen-zexi/open-ptc-agent · 32 tokens

docx

Comprehensive document creation, editing, and analysis with support for tracked changes, comments, formatting preservation, and text extraction. When Claude needs to work with professional documents (.docx files) for: (1) Creating new documents, (2) Modifying or editing content, (3) Working with tracked changes, (4)…

Chen-zexi/open-ptc-agent · 77 tokens

web-exfiltration-detection

Detect data exfiltration via URL path encoding and chained webfetch navigation. Covers fake trusted UI injection, letter-level URL path exfiltration, and multi-hop navigation hijacking. Use when the agent has web/URL fetch capability and stores user memory or personal context.

Tencent/AI-Infra-Guard · 61 tokens