x-scraper

x-scraper is a skill for Claude Code, Codex from inclusionAI/AWorld. It costs 71 tokens per session (872 once invoked), scanned A, original, MIT.

A scraper for X, formerly called Twitter, that collects posts from a chosen user's timeline or the signed-in home feed. It can filter by keyword and export Markdown, RSS, or JSON.

In plain words
What is it for?
Use it to collect recent posts from a user, filter them by a term, switch between the For You and Following feeds, control scrolling, and save the results.
Why use it?
It saves time when gathering posts from a timeline or feed that would otherwise need to be searched and copied manually.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to collect recent posts from a user, filter them by a term, switch between the For You and Following feeds, control scrolling, and save the results.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/inclusionai/aworld/x-scraper
About the project

AWorld is an agent harness, meaning a framework that coordinates an AI agent’s tools, memory, context, and execution so expert knowledge can be turned into reusable skills and autonomous agents. It is for building domain-specific agent applications and workflows, with the catalogue entries representing skills, agents, and commands that operate within the AWorld ecosystem.

inclusionAI/AWorld · 1,229 stars · on GitHub · aworldagents.com

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add inclusionAI/AWorld --skill x-scraper
Clone the repo
git clone --depth 1 https://github.com/inclusionAI/AWorld

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for x-scraper

README.md
[![agentmods](https://agentmods.dev/badge/skills/inclusionai/aworld/x-scraper/github.svg)](https://agentmods.dev/skills/inclusionai/aworld/x-scraper)
Your own site
<a href="https://agentmods.dev/skills/inclusionai/aworld/x-scraper"><img src="https://agentmods.dev/badge/skills/inclusionai/aworld/x-scraper/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for x-scraper

Your own site · 80×15
<a href="https://agentmods.dev/skills/inclusionai/aworld/x-scraper"><img src="https://agentmods.dev/badge/skills/inclusionai/aworld/x-scraper.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 71 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 872 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00071 $0.00872
Opus 5 $0.00036 $0.00436
Sonnet 5 $0.00014 $0.00174
Haiku 4.5 $0.00007 $0.00087

Measured 9d ago against content hash c5b55139b898, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

x-scraper scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

The scan reads SKILL.md. This mod also ships 2 executable files (scrape_x_home.sh, scrape_x_user.sh), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

examples/skill_agent/skills/x-scraper/SKILL.md · 89 lines

What it actually says

X 抓取 (x-scraper)

概述

通过已连接 CDP 的浏览器(agent-browser)抓取 X (Twitter) 内容,包含两个脚本:

  1. scrape_x_user.sh — 抓取指定用户时间线,可选关键词过滤
  2. scrape_x_home.sh — 抓取当前登录用户的首页推荐流(For you / Following)

输出格式统一支持 Markdown / RSS / JSON。

工具路径

  • 用户抓取:./scrape_x_user.sh
  • 首页推荐:./scrape_x_home.sh
  • 依赖:agent-browser(CDP 已连接且已登录 X)、python3

1. 用户帖子抓取 (scrape_x_user.sh)

按用户名抓取最新帖子,可选关键词搜索过滤。

用法

././scrape_x_user.sh [-u <username>] [-k <keyword>] [-p <cdp_port>] [-n <max_scrolls>] [-o <output_file>] [-f <format>]

参数

参数 说明 默认
-u X 用户名(不带 @) Alibaba_Qwen
-k 搜索关键词(可选,不指定则抓取用户全部最新帖子) -
-p CDP 端口 9222
-n 最大滚动次数 10
-o 输出文件路径 stdout
-f 格式:md | rss | json md

示例

././scrape_x_user.sh
././scrape_x_user.sh -k qwen3
././scrape_x_user.sh -u chenchengpro -k claw -f rss -o feed.xml
././scrape_x_user.sh -u chenchengpro -f json -n 20 -o data.json

2. 首页推荐流抓取 (scrape_x_home.sh)

抓取当前登录用户的 X 首页推荐内容,支持 For you / Following 两个 Tab 切换。

用法

././scrape_x_home.sh [-t <tab>] [-p <cdp_port>] [-n <max_scrolls>] [-o <output_file>] [-f <format>]

参数

参数 说明 默认
-t 推荐 Tab:foryou | following foryou
-p CDP 端口 9222
-n 最大滚动次数 5
-o 输出文件路径 stdout
-f 格式:md | rss | json md

输出字段

每条帖子包含:author(作者名 + handle)、time(ISO 时间戳)、text(正文)、link(帖子链接)、hasMedia(是否含图片/视频)、retweet(转推/置顶上下文)

示例

././scrape_x_home.sh                           # 抓取 For you 推荐流
././scrape_x_home.sh -t following -n 10        # 抓取 Following 时间线
././scrape_x_home.sh -f json -o feed.json      # JSON 输出到文件
././scrape_x_home.sh -n 3 -f rss -o home.xml   # 少量抓取,RSS 输出
Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 89 lines · 71 tokens per session scan A c5b55139b898

Subscribe to this mod's changes

x-scraper is a skill published in the GitHub repository inclusionAI/AWorld (1,229 stars, last pushed yesterday), licensed MIT. It adds 71 tokens to every session and 872 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

hive.browser-automation

Required before any hive-browser CLI command. The browser is driven from the terminal by running hive-browser ... --json via terminalexec — not via MCP tools. Teaches the browser lifecycle rules (the bridge attaches to the USER'S running Chrome — never kill or launch browser processes; timeouts are transport issues…

aden-hive/hive · 142 tokens

hive.linkedin-automation

Read before automating LinkedIn with browser tools. LinkedIn combines shadow DOM (#interop-outlet), strict Trusted Types CSP that silently drops innerHTML, Lexical composer, native beforeunload dialogs that hang the bridge, and aggressive spam filters — each has bitten us at least once. Verified flows for profile…

aden-hive/hive · 99 tokens

hive.x-automation

Read before automating X / Twitter with browser tools. Verified flows for post, reply, delete, search-and-engage, plus the Draft.js compose quirks that silently disable the send button. Includes the daily-reply and job-market-reply playbooks. Requires hive.browser-automation for the underlying screenshot + coordinate…

aden-hive/hive · 81 tokens

hive.slack-notifications-setup

Set up a Slack notification channel (Sentinel) for a colony by driving the browser — reuse or create the "Hive Sentinel" Slack app from a JSON manifest, install it, capture the bot + app tokens, create/select the channel via the Slack API, and turn Sentinel on so the colony can ping the user on Slack and accept…

aden-hive/hive · 136 tokens

browser-edge-cases

SOP for debugging browser automation failures on complex websites. Use when browser tools fail on specific sites like LinkedIn, Twitter/X, SPAs, or sites with Shadow DOM.

aden-hive/hive · 40 tokens

browser-automation

Playwright-based browser automation patterns for autonomous web interaction.

RightNow-AI/openfang · 14 tokens