ComradeCoding shop

RSS and Atom to JSON

Turn RSS, Atom and JSON Feed URLs into clean, deduplicated JSON rows, with optional full article text. $0.0005 per item.

Get it on Apify, $0.0005 per item

Give it a list of feed URLs and get one flat JSON row per item, with the same field names whether the source is RSS, Atom or JSON Feed: title, link, author, published and updated dates in ISO 8601 UTC, a plain-text summary, categories, image, and enclosure (podcast audio). You can also give it a web page and it follows the feed that page declares.

It fixes common feed problems for you: wrong character encodings, dates with no time zone, and HTML in descriptions. Items that appear in more than one feed come back once.

Two options go further. Full text opens each item's link and adds the main article text as Markdown. Only-new mode remembers what earlier runs returned, so a scheduled run gives you just the new items.

It checks robots.txt and waits out any Crawl-delay.

Limits: public feeds only, no logins. It reads what the feed holds right now, usually the last 10 to 50 items, not the site's archive. Full text works on articles, not on pages built entirely with JavaScript.

How-to guide: How to Convert an RSS or Atom Feed to JSON

Get it on Apify

Related

See all products