news-scraper commands

10 tagged news-scraper, measured the same way as everything else here.

Browse within: news 10rss 10rss-feed-parser 10scraper 10

analyze

01

ivbeg/newsworker

Command

Runs the dynamic heuristics once and distils them into a portable YAML parsing spec. Feeding that spec back into extract --spec skips analysis and runs deterministic selectors.

87 13d ago A 5 tokens original MIT

extract

02

ivbeg/newsworker

Command

Extracts news items from an HTML page and renders them in the chosen format.

87 13d ago A 5 tokens original MIT

serve

03

ivbeg/newsworker

Command

Runs a lightweight local HTTP server (Python standard library, no extra dependencies) that turns any page URL into a feed on demand over GET.

87 13d ago A 5 tokens original MIT