feedgrab AGENTS.md

feedgrab AGENTS.md is an instructions file for Codex, OpenCode from iBigQiang/feedgrab. It costs 17,006 tokens per session, scanned A, original, MIT.

Project instructions for feedgrab, a tool that collects content from many online platforms and converts it into structured Markdown files that work with Obsidian, a note-taking app.

In plain words
What is it for?
Fetching posts, videos, subtitles, metadata, or articles from supported platforms, then turning them into Markdown or exposing the work as tools.
Why use it?
They explain the project's three layers and supported platforms so an agent can choose the right way to fetch or process content.

Instructions file for CodexOpenCode

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add instructions/ibigqiang/feedgrab/agents-md
Clone the repo
git clone --depth 1 https://github.com/iBigQiang/feedgrab

Made for: Codex, OpenCode.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for feedgrab AGENTS.md

README.md
[![agentmods](https://agentmods.dev/badge/instructions/ibigqiang/feedgrab/agents-md.svg)](https://agentmods.dev/instructions/ibigqiang/feedgrab/agents-md)
Your own site
<a href="https://agentmods.dev/instructions/ibigqiang/feedgrab/agents-md"><img src="https://agentmods.dev/badge/instructions/ibigqiang/feedgrab/agents-md.svg" alt="Measured on agentmods" height="20"></a>
Per session 17,006 This file is loaded in full into every session.
When invoked 17,006 The same file — it is already loaded in full.
Security scan A 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.17006 $0.17006
Opus 5 $0.08503 $0.08503
Sonnet 5 $0.03401 $0.03401
Haiku 4.5 $0.01701 $0.01701

Measured today against content hash 1ad988644781, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

feedgrab AGENTS.md scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured today.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

`utils/http_client.py` 提供统一 HTTP 客户端:curl_cffi `Session(impersonate="chrome")` 模拟 Chrome TLS 指纹(JA3/JA4 完全匹配),fallback 到标准 requests。所有 fetcher 的 `requests.get()`/`urllib.request.urlopen()` 均已迁移到 `http_client.get()`/`http
AGENTS.md · 492 lines

How it starts

The opening of the file, as written. The whole thing — 492 lines — stays where its author put it; the contents beside it link to each section on GitHub.

feedgrab 项目指令

项目概述

feedgrab 是一个万能内容抓取器,从任意平台抓取内容并输出为 Obsidian 兼容的结构化 Markdown。

项目来源

feedgrab 由两个项目融合升级而来:

  • x-reader(@runes_leo)— 提供多平台架构、CLI、MCP 服务器
  • baoyu-danger-x-to-markdown(@dotey 宝玉)— 提供逆向工程的 X/Twitter GraphQL 深度抓取能力

三层架构

层级 功能 入口
Python CLI/库 基础内容抓取 + 统一数据结构 feedgrab <url>
Codex 技能 视频转录 + AI 分析 skills/video/ skills/analyzer/
MCP 服务器 将抓取能力暴露为 MCP 工具 mcp_server.py

支持的平台

平台 抓取方式
X/Twitter GraphQL → FxTwitter → Syndication → oEmbed → Jina → Playwright(六级兜底)
小红书 API (xhshow) → Pinia Store 注入 → Jina → Playwright 深度抓取(单篇 + 作者批量 + 搜索批量 + xhs-so 搜索)
YouTube InnerTube API 字幕(零依赖零 quota)→ yt-dlp 字幕 → Groq Whisper 转录 + YouTube Data API v3 搜索 + yt-dlp 下载
B站 view API 元数据 + 字幕 3 级兜底(player/v2player/wbi/v2 WBI → Whisper 可选)
微信公众号 Playwright WeChat JS 提取 → Jina 兜底(单篇 + markdownify 富文本)/ 搜狗搜索(关键词搜索)/ MP 后台 API(按账号批量)/ 专辑批量(mpweixin-zhuanji
GitHub REST API(仓库元数据 + 中文 README 优先 + 摘要提取)
LinuxDo / IDCFlare / Discourse Discourse Topic JSON API → CDP 复用 Chrome → Playwright 页面内 fetch → Jina(默认主贴 + 楼主自回,可切换完整楼层)
飞书/Lark Open API → CDP 直连 → Playwright PageMain Block 树 → Jina(单篇 + 知识库批量 + 嵌入表格 + 图片下载;修复虚拟目录树与表格错位)
金山文档/KDocs Playwright ProseMirror DOM 提取(虚拟滚动 + 代码块 + 图片 shapes API + CDP 直连)
FlowUs 息流 Tier 0 纯 HTTP /api/docs/{uuid}(公开零 cookie / 付费需 next_auth+next_auth.sig 双 cookie)→ CDP → Launch+saved session → Jina;Notion 风格 block-tree 渲染;默认在线签名图 URL,可开启本地图片附件
有道云笔记 JSON API(零依赖)→ Playwright iframe DOM → Jina(单篇 + 图片下载)
知乎 API v4 → Playwright CDP/DOM → Jina(单篇问答前 3 楼 + 专栏文章 + 关键词搜索 zhihu-so
Telegram Telethon
小宇宙 SSR __NEXT_DATA__ + Groq Whisper 转录
喜马拉雅 Web Revision API + canPlay 降级 + Groq Whisper(免费节目)
RSS feedparser
Reddit old.reddit.com .json + 自报 UA → CDP 复用 Chrome → Stealth Playwright + saved session → Jina(REDDIT_REPLY_MODE=top/tree/all + reddit-sub + reddit-so
知识星球 Tier 0 HTTP cookie(articles SSR HTML / topic API JSON)→ Tier 1 CDP 复用 → Tier 2 Stealth Browser → Tier 3 Jina;短链 t.zsxq.com 302 解析;topic 五形态:talk/question+answer/article/solution;评论三态
付费新闻(300+) 7 级 Tier 绕过(JSON-LD → Googlebot/Bingbot UA → AMP → EU IP → archive.today → Google Cache → Jina)
任意网页 JSON-LD 前置探测 → Jina 兜底

Read the full file on GitHub · 492 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. today Changed · +32 lines · +1,939 tokens per session 1ad988644781
  2. 4d ago First seen · 460 lines · 15,067 tokens per session scan A b34cf2856dbf

Subscribe to this mod's changes

feedgrab AGENTS.md is an instructions file published in the GitHub repository iBigQiang/feedgrab (606 stars, last pushed 3d ago), licensed MIT. It adds 17,006 tokens to every session, about $0.0850 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other instructions, from other repositories

vscode buildNext.instructions.md

Working notes and architecture documentation for the new esbuild-based build system in build/next. Use when making changes to the new build pipeline (transpile/bundle commands, NLS plugin, source-map handling, resource copying, or self-hosting watch tasks).

microsoft/vscode · 6,785 tokens

spec-kit AGENTS.md

AGENTS.md instructions for github/spec-kit, covering agents.md, about spec kit and specify, quickstart — add a new integration in 5 steps, integration architecture and integrationmanifest — file tracking.

github/spec-kit · 7,104 tokens

codex AGENTS.md

AGENTS.md instructions for openai/codex, covering rust/codex-rs, the codex-core crate, code review rules, crate api surface and model visible context.

openai/codex · 5,182 tokens

langchain AGENTS.md

AGENTS.md instructions for langchain-ai/langchain, covering global development guidelines for the langchain monorepo, corridor security analysis, project architecture and context, monorepo structure and development tools & commands.

langchain-ai/langchain · 4,345 tokens

vscode oss-third-party-notices.instructions.md

Instructions for microsoft/vscode, covering vs code oss third-party-notices pipeline, architecture, pipeline flow in ci, applying the notice (cutover) and fallback chain (never fail the build).

microsoft/vscode · 5,001 tokens

next.js AGENTS.md

Instructions for vercel/next.js, covering next.js development guide, codebase structure, monorepo overview, core package: packages/next and other important packages.

vercel/next.js · 7,296 tokens