Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add instructions/ibigqiang/feedgrab/agents-mdgit clone --depth 1 https://github.com/iBigQiang/feedgrabWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/instructions/ibigqiang/feedgrab/agents-md)<a href="https://agentmods.dev/instructions/ibigqiang/feedgrab/agents-md"><img src="https://agentmods.dev/badge/instructions/ibigqiang/feedgrab/agents-md.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.17006 | $0.17006 |
| Opus 5 | $0.08503 | $0.08503 |
| Sonnet 5 | $0.03401 | $0.03401 |
| Haiku 4.5 | $0.01701 | $0.01701 |
Grade A, and why
feedgrab AGENTS.md scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured today.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Makes network callslowCapability
Not a fault in itself. Listed so you know the mod talks to something, and to what.
`utils/http_client.py` 提供统一 HTTP 客户端:curl_cffi `Session(impersonate="chrome")` 模拟 Chrome TLS 指纹(JA3/JA4 完全匹配),fallback 到标准 requests。所有 fetcher 的 `requests.get()`/`urllib.request.urlopen()` 均已迁移到 `http_client.get()`/`http How it starts
The opening of the file, as written. The whole thing — 492 lines — stays where its author put it; the contents beside it link to each section on GitHub.
feedgrab 项目指令
项目概述
feedgrab 是一个万能内容抓取器,从任意平台抓取内容并输出为 Obsidian 兼容的结构化 Markdown。
- 仓库:https://github.com/iBigQiang/feedgrab
- 作者:@iBigQiang(强子手记)
- 当前版本:v0.26.2
- Python:≥3.10
- 许可证:MIT
项目来源
feedgrab 由两个项目融合升级而来:
- x-reader(@runes_leo)— 提供多平台架构、CLI、MCP 服务器
- baoyu-danger-x-to-markdown(@dotey 宝玉)— 提供逆向工程的 X/Twitter GraphQL 深度抓取能力
三层架构
| 层级 | 功能 | 入口 |
|---|---|---|
| Python CLI/库 | 基础内容抓取 + 统一数据结构 | feedgrab <url> |
| Codex 技能 | 视频转录 + AI 分析 | skills/video/ skills/analyzer/ |
| MCP 服务器 | 将抓取能力暴露为 MCP 工具 | mcp_server.py |
支持的平台
| 平台 | 抓取方式 |
|---|---|
| X/Twitter | GraphQL → FxTwitter → Syndication → oEmbed → Jina → Playwright(六级兜底) |
| 小红书 | API (xhshow) → Pinia Store 注入 → Jina → Playwright 深度抓取(单篇 + 作者批量 + 搜索批量 + xhs-so 搜索) |
| YouTube | InnerTube API 字幕(零依赖零 quota)→ yt-dlp 字幕 → Groq Whisper 转录 + YouTube Data API v3 搜索 + yt-dlp 下载 |
| B站 | view API 元数据 + 字幕 3 级兜底(player/v2 → player/wbi/v2 WBI → Whisper 可选) |
| 微信公众号 | Playwright WeChat JS 提取 → Jina 兜底(单篇 + markdownify 富文本)/ 搜狗搜索(关键词搜索)/ MP 后台 API(按账号批量)/ 专辑批量(mpweixin-zhuanji) |
| GitHub | REST API(仓库元数据 + 中文 README 优先 + 摘要提取) |
| LinuxDo / IDCFlare / Discourse | Discourse Topic JSON API → CDP 复用 Chrome → Playwright 页面内 fetch → Jina(默认主贴 + 楼主自回,可切换完整楼层) |
| 飞书/Lark | Open API → CDP 直连 → Playwright PageMain Block 树 → Jina(单篇 + 知识库批量 + 嵌入表格 + 图片下载;修复虚拟目录树与表格错位) |
| 金山文档/KDocs | Playwright ProseMirror DOM 提取(虚拟滚动 + 代码块 + 图片 shapes API + CDP 直连) |
| FlowUs 息流 | Tier 0 纯 HTTP /api/docs/{uuid}(公开零 cookie / 付费需 next_auth+next_auth.sig 双 cookie)→ CDP → Launch+saved session → Jina;Notion 风格 block-tree 渲染;默认在线签名图 URL,可开启本地图片附件 |
| 有道云笔记 | JSON API(零依赖)→ Playwright iframe DOM → Jina(单篇 + 图片下载) |
| 知乎 | API v4 → Playwright CDP/DOM → Jina(单篇问答前 3 楼 + 专栏文章 + 关键词搜索 zhihu-so) |
| Telegram | Telethon |
| 小宇宙 | SSR __NEXT_DATA__ + Groq Whisper 转录 |
| 喜马拉雅 | Web Revision API + canPlay 降级 + Groq Whisper(免费节目) |
| RSS | feedparser |
old.reddit.com .json + 自报 UA → CDP 复用 Chrome → Stealth Playwright + saved session → Jina(REDDIT_REPLY_MODE=top/tree/all + reddit-sub + reddit-so) |
|
| 知识星球 | Tier 0 HTTP cookie(articles SSR HTML / topic API JSON)→ Tier 1 CDP 复用 → Tier 2 Stealth Browser → Tier 3 Jina;短链 t.zsxq.com 302 解析;topic 五形态:talk/question+answer/article/solution;评论三态 |
| 付费新闻(300+) | 7 级 Tier 绕过(JSON-LD → Googlebot/Bingbot UA → AMP → EU IP → archive.today → Google Cache → Jina) |
| 任意网页 | JSON-LD 前置探测 → Jina 兜底 |
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- today Changed · +32 lines · +1,939 tokens per session 1ad988644781
- 4d ago First seen · 460 lines · 15,067 tokens per session scan A b34cf2856dbf
feedgrab AGENTS.md is an instructions file published in the GitHub repository iBigQiang/feedgrab (606 stars, last pushed 3d ago), licensed MIT. It adds 17,006 tokens to every session, about $0.0850 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other instructions, from other repositories
vscode buildNext.instructions.md
Working notes and architecture documentation for the new esbuild-based build system in build/next. Use when making changes to the new build pipeline (transpile/bundle commands, NLS plugin, source-map handling, resource copying, or self-hosting watch tasks).
spec-kit AGENTS.md
AGENTS.md instructions for github/spec-kit, covering agents.md, about spec kit and specify, quickstart — add a new integration in 5 steps, integration architecture and integrationmanifest — file tracking.
codex AGENTS.md
AGENTS.md instructions for openai/codex, covering rust/codex-rs, the codex-core crate, code review rules, crate api surface and model visible context.
langchain AGENTS.md
AGENTS.md instructions for langchain-ai/langchain, covering global development guidelines for the langchain monorepo, corridor security analysis, project architecture and context, monorepo structure and development tools & commands.
vscode oss-third-party-notices.instructions.md
Instructions for microsoft/vscode, covering vs code oss third-party-notices pipeline, architecture, pipeline flow in ci, applying the notice (cutover) and fallback chain (never fail the build).
next.js AGENTS.md
Instructions for vercel/next.js, covering next.js development guide, codebase structure, monorepo overview, core package: packages/next and other important packages.