Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add roedyrustam/vibes-plug --skill web-scrapergit clone --depth 1 https://github.com/roedyrustam/vibes-plugWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/roedyrustam/vibes-plug/web-scraper)<a href="https://agentmods.dev/skills/roedyrustam/vibes-plug/web-scraper"><img src="https://agentmods.dev/badge/skills/roedyrustam/vibes-plug/web-scraper/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/roedyrustam/vibes-plug/web-scraper"><img src="https://agentmods.dev/badge/skills/roedyrustam/vibes-plug/web-scraper.svg" alt="Reviewed on agentmods" width="80" height="20"></a>- NVIDIA SkillSpector warn
SkillSpector: 1 finding, up to medium
These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →
- medium Excessive Agency · line 113 Skill enables autonomous high-impact decisions without human-in-the-loop verification. Critical operations (destructive commands, financial transactions, data deletion) should require explicit user confirmation.Fix: Add human-in-the-loop confirmation for destructive, irreversible, or high-impact operations. Never auto-execute commands that modify files, send data, or alter system state.
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00084 | $0.02186 |
| Opus 5.5 | $0.00034 | $0.00874 |
| Sonnet 5.5 | $0.00017 | $0.00437 |
| Haiku 4.5 | $0.00008 | $0.00219 |
Grade A, and why
web-scraper scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 171 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Agentic Web Scraper Expert (2026 Edition)
English
Orchestration & Integration
- Upstream Orchestrators: Works under
brainstormingandzero-to-prod-orchestrator(Phase 1 & Phase 5 - Extraction & Data Pipelines) to gather web data. - Downstream Cooperating Skills:
browser-automation-expert— Hardcore anti-bot evasion, stealth Playwright execution, and Cloudflare bypass.ai-llm-integration-expert— LLM schema-driven structured data extraction from DOM markdown.deep-research-analyst— Feed extracted web sources to multi-source evidence synthesis.data-pipeline-etl-expert— Ingest extracted datasets into transformation and analytics storage.session-memory-manager— Cache scraped web structures and extraction progress checkpoints.
Description
Advanced Agentic Web Scraping utilizing modern multi-strategy data extraction. Leverages Crawl4AI v4 and Firecrawl to convert raw DOMs into LLM-friendly Markdown. Implements Agentic Extraction loops where the LLM guides the scraper dynamically based on page state. Incorporates strategies for bypassing anti-bot measures (Cloudflare Turnstile, Datadome) and navigating dynamic Shadow DOMs.
Trigger Conditions
- Extracting structured data from websites for analysis, training data, or content pipelines.
- Scraping dynamic JavaScript-rendered pages and complex SPAs.
- Converting web pages to clean Markdown for LLM context or RAG pipelines.
- Dealing with anti-bot protections or complex Shadow DOM architectures during scraping.
- Implementing an automated agentic data extraction loop.
Extracting DOM into LLM-Friendly Markdown
Use Crawl4AI v4 for high-performance async extraction and Firecrawl for seamless LLM-ready conversion.
Crawl4AI v4 (Async Python):
import asyncio
from crawl4ai import AsyncWebCrawler, BrowserConfig, CrawlerRunConfig, CacheMode
async def extract_markdown(url: str):
config = BrowserConfig(headless=True, bypass_csp=True)
run_config = CrawlerRunConfig(
cache_mode=CacheMode.ENABLED,
remove_overlay_elements=True,
word_count_threshold=50
)
async with AsyncWebCrawler(config=config) as crawler:
result = await crawler.arun(url=url, config=run_config)
# Returns clean, AI-optimized markdown ready for LLM consumption
return result.markdown.fit_markdown
What ships with it
3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 4d ago Changed · +11 lines · +84 tokens per session 6754b6c91dce
- 5d ago Changed · +2 lines · -84 tokens per session 4f15d40c1ef8
- 8d ago Changed b757c5590170
- 17d ago Changed 7b48ccb54dcc
- 22d ago Changed 791c888aa97c
- 23d ago Changed 782daac3c5ec
- 25d ago Changed · -6 lines · +74 tokens per session 3c29d030f720
- 27d ago Changed · +6 lines · -74 tokens per session 5b937d996769
- 1mo ago Changed 4552c72c12d9
- 1mo ago First seen · 158 lines · 84 tokens per session scan A 4d68d9421f6a
web-scraper is a skill published in the GitHub repository roedyrustam/vibes-plug (113 stars, last pushed today), licensed MIT. It adds 84 tokens to every session and 2,186 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.
Other skills, from other repositories
webapp-testing
Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.
ai-engineering-toolkit
Overview of six AI engineering workflows: prompt evaluation (8-dimension scoring), context budget planning, RAG pipeline design, agent security audit (65-point checklist), eval harness building, and product sense coaching.
ai-prompt-regression-testing
Use when comparing prompt changes against a fixed evaluation set: record actual model settings, required checks, missing results, judge limitations and case-level regression evidence.
browser-testing-with-devtools
Tests in real browsers via Chrome DevTools MCP. Use when building or debugging anything that runs in a browser. Use when you need to inspect the DOM, capture console errors, analyze network requests, profile performance, or verify visual output with real runtime data. Requires the chrome-devtools MCP server to be…
cue
Writing and producing product videos: scripts, storyboards, narration, and reproducible Playwright demo recordings. Use for explainers, onboarding, feature walkthroughs, multi-aspect exports, captions, and video quality checks.
control-ui
Drive and inspect a local web, IDE, or Electron UI with browser or CDP automation and evidence. Use for UI regressions, screenshots, accessibility snapshots, visual diffs, focus, keyboard, scrolling, resize, console, network, performance, or heap checks. Do not use for backend-only changes or for a screenshot without…