apify-blocked-scrape-triage

apify-blocked-scrape-triage is a skill for Claude Code from apify/awesome-skills. It costs 216 tokens per session (11,248 once invoked), scanned A, original, Apache-2.0.

A troubleshooting workflow for web scrapes that return blocked, empty, incomplete, or missing results. It investigates likely causes in cost order, starting with basic checks and using browser automation only later.

In plain words
What is it for?
Use it for 403 or 429 responses, challenge pages, zero results, truncated pages, connection failures, and differences between a browser view and an automated run.
Why use it?
It prevents you from treating every failed scrape as bot detection and spending money on a more complex scraper before checking simpler explanations.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin.

Part of the awesome-skills plugin — 29 skills shipped together

Good fit Use it for 403 or 429 responses, challenge pages, zero results, truncated pages, connection failures, and differences between a browser view and an automated run.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/apify/awesome-skills/apify-blocked-scrape-triage
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add apify/awesome-skills --skill apify-blocked-scrape-triage
Clone the repo
git clone --depth 1 https://github.com/apify/awesome-skills

Made for: Claude Code.

Or install awesome-skills, the plugin that ships this one along with the rest of its 29 skills.

Its marketplace also offers this one on its own, as the plugin apify-blocked-scrape-triage — /plugin install apify-blocked-scrape-triage after adding the marketplace above.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for apify-blocked-scrape-triage

README.md
[![agentmods](https://agentmods.dev/badge/skills/apify/awesome-skills/apify-blocked-scrape-triage/github.svg)](https://agentmods.dev/skills/apify/awesome-skills/apify-blocked-scrape-triage)
Your own site
<a href="https://agentmods.dev/skills/apify/awesome-skills/apify-blocked-scrape-triage"><img src="https://agentmods.dev/badge/skills/apify/awesome-skills/apify-blocked-scrape-triage/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for apify-blocked-scrape-triage

Your own site · 80×15
<a href="https://agentmods.dev/skills/apify/awesome-skills/apify-blocked-scrape-triage"><img src="https://agentmods.dev/badge/skills/apify/awesome-skills/apify-blocked-scrape-triage.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 216 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 11,248 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00216 $0.11248
Opus 5.5 $0.00086 $0.04499
Sonnet 5.5 $0.00043 $0.02250
Haiku 4.5 $0.00022 $0.01125

Measured 28d ago against content hash 28e2085c5227, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

apify-blocked-scrape-triage scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 28d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl -s "http://ip-api.com/json/?fields=query,country,as,org,hosting"
skills/apify-blocked-scrape-triage/SKILL.md · 344 lines

How it starts

The opening of the file, as written. The whole thing — 344 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Blocked scrape triage

A scrape came back wrong. Find out why before changing anything, then escalate in cost order. Most "blocks" are not bot detection, some are not even a live server, and the browser is the most expensive answer rather than the first one.

Work the steps in order. Step 0 ends more investigations than the whole ladder does.

Prerequisites

  • Apify account (sign up)
  • Authentication via one of:
  • A one-time permission approval, before the first diagnostic run. apify/cheerio-scraper requires full account access and refuses to start until that is approved in the Console. Both paths refuse, with different wording: MCP call-actor answers requires full access to your account. You must approve its permissions before running it, while the CLI prints Error: Actor apify/cheerio-scraper requires full access to your Apify account and has not been approved yet. on stdout with exit code 0 — so an unattended CLI flow reads it as a normal result and stops without saying why. Approve it once at the URL the message prints, before you need a diagnosis. The same applies to apify/web-scraper and the browser Actors in Rung 5; apify/website-content-crawler does not require it.

What a diagnosis is allowed to cost

One DNS pair, one navigation per egress per host, then stop and conclude. The unit is the host, not the organisation: one county published its records across three hostnames that refused a request in three different ways, and a budget spent on "the target" would have bought one of those three answers. The budget counts requests to hosts the target owns; looking something up on a third-party platform, a data catalogue or your own IP check is free. If you are four requests into one host and still cannot name the cause, you are no longer diagnosing, you are probing, and you should say what you know and what it would cost to learn more. One navigation means one page: a browser pulling forty subresources for that page is still one navigation, and a burst of repeated probes is not. The one exception worth spending on is the residential probe in Step 3, a single run that separates "your network" from "actually defended".

Read the full file on GitHub · 344 lines

Files

What ships with it

4 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 28d ago First seen · 344 lines · 216 tokens per session scan A 28e2085c5227

Subscribe to this mod's changes

apify-blocked-scrape-triage is a skill published in the GitHub repository apify/awesome-skills (280 stars, last pushed 27d ago), licensed Apache-2.0. It adds 216 tokens to every session and 11,248 once invoked, about $0.0009 per session on Opus 5.5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-22.

Related

Other skills, from other repositories

apify-actor-development

Create, modify, debug, and deploy Apify Actors, and write their input and output schemas. Use when building an Actor from scratch, changing or troubleshooting Actor code, generating or updating .actor schema files, or pushing an Actor to the Apify platform. To wrap an existing non-Actor project, use apify-actorization…

apify/agent-skills · 75 tokens

apify-ultimate-scraper

Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research…

apify/agent-skills · 97 tokens

CodeShuX__mockhunter

Audit a live web page to find mock data, hardcoded values, LLM-fabricated metrics, and broken endpoints. Opens the URL in Playwright, clicks every interactive element, traces every visible value to its actual source (DB/API/mock/LLM/hardcoded), and produces a markdown report. Use when the user wants a reality check on…

Bilal140202/the-lord-of-the-skills · 90 tokens

browser-testing-with-devtools

Verify web apps with browser DevTools—DOM, console, network, performance, and accessibility at runtime. Use with Chrome DevTools MCP or headless browser tools.

charlieviettq/awesome-agent-skill · 39 tokens

chrome-devtools-cli

Use this skill to write shell scripts or run shell commands to automate tasks in the browser or otherwise use Chrome DevTools via CLI.

ChromeDevTools/chrome-devtools-mcp · 31 tokens

chrome-devtools

Uses Chrome DevTools via MCP for efficient debugging, troubleshooting and browser automation. Use when debugging web pages, automating browser interactions, analyzing performance, or inspecting network requests. This skill does not apply to --slim mode (MCP configuration).

ChromeDevTools/chrome-devtools-mcp · 55 tokens