browser-scrape

A browser-based scraping tool that reuses your logged-in Chrome session to collect content from Twitter/X, Zhihu, Bilibili, Reddit, and more than 55 other sites.

In plain words
What is it for?
Use it to collect timelines, searches, trending lists, subreddit posts, or article text in formats such as JSON, Markdown, text, YAML, or CSV.
Why use it?
It avoids setting up cookies or API keys when a site requires a login. It can also read ordinary web articles directly.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/channinglua/prax-agent/browser-scrape
Any agent
npx skills add ChanningLua/prax-agent --skill browser-scrape
Clone the repo
git clone --depth 1 https://github.com/ChanningLua/prax-agent

Made for: Claude Code, Codex.

Per session 39 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,034 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00039 $0.01034
Opus 5 $0.00019 $0.00517
Sonnet 5 $0.00008 $0.00207
Haiku 4.5 $0.00004 $0.00103

Measured 2d ago against content hash 42866d05a5f5, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

browser-scrape scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

src/prax/skills/browser-scrape/SKILL.md · 83 lines

How it starts

The opening of the file, as written. The whole thing — 83 lines — stays where its author put it; the contents beside it link to each section on GitHub.

浏览器抓取技能(AutoCLI)

复用用户本机 Chrome 的登录态抓取需要登录的站点(推特/X、知乎、Bilibili、Reddit、小红书等 55+ 平台)。不需要 cookie 配置、不需要 API key。

前置要求(由用户完成一次即可)

  1. 安装 AutoCLI Rust 二进制:参见 https://github.com/nashsu/AutoCLI(单文件 ~4.7MB,无运行时依赖)
  2. 装 autocli Chrome 扩展(仓库 README 里有下载链接和加载步骤)
  3. 保持 Chrome 运行并在目标站点处于登录态
  4. autocli doctor 应报告 OK

如果 autocli doctor 失败,先提醒用户修复前置条件,不要继续抓取。

能力范围

AutoCLI 在 Prax 里通过普通 Bash 工具调用——它不是 MCP server,只是一个 CLI。只要 PATH 里能找到 autocli,任何 Prax agent 都能用。

常用命令(按频次排序)

# 诊断(第一次使用必跑)
autocli doctor

# 推特/X
autocli twitter timeline --limit 20 --format json
autocli twitter search --query "AI safety" --limit 10 --format json

# 知乎
autocli zhihu hot --limit 20 --format json

# Bilibili
autocli bilibili hot --limit 10 --format json

# Reddit
autocli reddit subreddit --name "MachineLearning" --limit 15 --format json

# 任意网页文章(不走登录态)
autocli read https://example.com/article --format md
autocli read https://example.com/article --format text -o /tmp/article.txt
  • --format json|md|text|yaml|csv 任选;编程任务优先 json,归档任务用 md
  • --limit N 控制条数
  • autocli --help 查所有子命令;单平台用 autocli twitter --help

典型抓取流程

用户让我"抓今天 X 上 AI 相关点赞 top 10 存到 Obsidian",我的动作:

  1. autocli doctor 确认前置条件
  2. autocli twitter timeline --limit 50 --format json 拉最近推文
  3. 本地过滤(按关键词/点赞数),用 Write 工具存到 .prax/vault/ai-news-hub/YYYY-MM-DD/
  4. 每条一个 markdown 文件,header 带 tweet_id / author / likes / url / scraped_at
  5. 完成后总结文件路径给用户

产出约定(配合 knowledge-compile 技能)

  • 目录命名.prax/vault/<topic>/YYYY-MM-DD/(方便 Obsidian 按日期归档)
  • 文件命名<source>-<id>.md,例如 twitter-17xxx.md
  • 文件 frontmatter:至少包含 source / url / scraped_at,供下游 knowledge-compile 编译 wiki 用
  • 原始 JSON 保留:把 autocli ... --format json 的原始输出同步存一份到 raw/<source>-<stamp>.json,便于溯源

边界与禁区

  • 不要用 AutoCLI 做 写操作(发帖/点赞/关注)除非用户明确要求;无脑批量操作会导致账号封禁
  • 不要把登录 cookie 或扩展私钥外传
  • 被站点频控或返回异常时先停下来报告,不要循环重试——可能会触发风控

配合其他技能

  • 抓完 → knowledge-compile 把散文件整理成 wiki
  • 每天定时运行 → cron 里配 prax cron add 用本技能
  • 出成品 → Notify 工具把结果推到飞书/邮箱

Read the full file on GitHub · 83 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 83 lines · 39 tokens per session scan A 42866d05a5f5

Subscribe to this mod's changes

browser-scrape is a skill published in the GitHub repository ChanningLua/prax-agent (272 stars, last pushed 1mo ago), licensed MIT. It adds 39 tokens to every session and 1,034 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories