Skill Claude CodeCodex
Proven scraping playbook for nike.com. Skip the browser entirely — replay the internal api.nike.com productwall endpoint directly with fetch. Public API, no cookies, no tokens, no anti-bot. Requires the nike-api-caller-id header and count=24 per page. Activate for any nike.com gridwall (/w/ URLs). Covers endpoint…
Skill Claude CodeCodex
Proven scraping playbook for producthunt.com homepage. Cloudflare-protected Next.js-ish SPA (no NEXTDATA), but a puppeteer.connect() to the user's real Chrome via the real Chrome debug port walks straight through the CF challenge with zero stealth plugins. All homepage posts are server-rendered into the HTML as…
Skill Claude CodeCodex
Proven scraping playbook for pypi.org. The /search HTML page is behind a FullStory client challenge (fs-ch-), but PyPI publishes an official RSS feed for newest packages at /rss/packages.xml with zero anti-bot. Use the RSS feed (or the JSON API) instead of scraping /search. Activate for any pypi.org target.
Skill Claude CodeCodex
Proven scraping playbook for reddit.com. Skip the browser entirely — Reddit exposes a public JSON API by appending .json to any listing URL (subreddit, user, comments, search). No auth, no cookies, no anti-bot beyond a User-Agent check. Activate for any reddit.com listing or thread URL.
Skill Claude CodeCodex
Proven scraping playbook for redfin.com listings. The HTML pages are CloudFront-blocked (403) on bare curl, but Redfin exposes a public undocumented endpoint at /stingray/api/gis-csv that returns the entire region's listings as CSV with no auth, no cookies, no anti-bot. Skip the browser entirely. Activate for any…
Skill Claude CodeCodex
Proven scraping playbook for stackoverflow.com tag/question listing pages (e.g. /questions/tagged/ ). Server-rendered HTML, but Cloudflare flags raw curl/node-fetch with HTTP 403 after the very first request. Connecting to the user's real Chrome via the real Chrome debug port walks straight through with zero…
Skill Claude CodeCodex
Proven scraping playbook for stockx.com listing pages (e.g. /sneakers/most-active, /sneakers/release-date, category leaderboards). Cloudflare hard-blocks bare curl with cf-mitigated: challenge + HTTP 403, but a puppeteer connection to the user's real Chrome via the real Chrome debug port walks straight through with…
Skill Claude CodeCodex
Proven scraping playbook for target.com. Skip the browser entirely — replay the internal redsky.target.com plpsearchv2 endpoint directly with fetch. Public API, no cookies, no auth, no anti-bot (HumanSecurity/PerimeterX is only enforced on www.target.com HTML, not on redsky). Activate for any target.com search…
Skill Claude CodeCodex
Proven scraping playbook for ubereats.com category pages (/category/ / ). Fully server-rendered HTML behind Cloudflare, no anti-bot challenge on curl — plain GET returns every store card in the markup. No browser, no stealth, no proxy, no auth. One gotcha — Uber ships a 40KB+ CSP header that overflows Node's built-in…
Skill Claude CodeCodex
Proven scraping playbook for walmart.com. Next.js SPA behind Akamai Bot Manager — curl is 307-redirected to /blocked, but a puppeteer connection to the user's real Chrome (127.0.0.1:9222) walks straight through with zero challenges. All product data is embedded in NEXTDATA; no API replay needed. Activate for any…
Skill Claude CodeCodex
Proven scraping playbook for en.wikipedia.org (and other language wikis). Server-rendered static HTML, no anti-bot, no JS required. Plain fetch + cheerio works. One important gotcha — since 2023, section headings are wrapped in so h2 is no longer a direct child of .mw-parser-output. Activate for any wikipedia.org…
Skill Claude CodeCodex
Proven scraping playbook for yelp.com search result pages (/search?finddesc=...&findloc=...). Yelp is behind DataDome — bare curl gets HTTP 403 with server: DataDome and a captcha-delivery interstitial. A real Chrome session via the real Chrome debug port walks straight through after the first navigation (no captcha…
Skill Claude CodeCodex
Proven scraping playbook for zillow.com /homes/forsale/ search pages. CloudFront + PerimeterX (HumanSecurity) gates raw curl with HTTP 403 x-px-blocked: 1. A puppeteer.connect() to the user's real Chrome via the real Chrome debug port walks through the challenge — but only if you (a) clear poisoned cookies first and…