Integration with Web feeds ¶

RSS and Atom feeds could be collected using rss2email program. It converts all incoming feed entries to email messages. Read about how to integrate Integration with Postfix/Integration with Exim with email. rss2email could be run in a cron, to collect feeds without any user interaction. Also this program supports ETags and won’t pollute the channel if remote server supports them too.

After installing rss2email, create configuration file:

$ r2e new rss-robot@address.com

and add feeds you want to retrieve:

$ r2e add http://www.nncpgo.org/download/releases.atom

and run the process:

$ r2e run

But it is more flexible and advisable to use use feeder (NNCP’s author creation) that also transforms feed entries to Maildir email messages. Incoming entries are placed in new/ Maildir directories, so you can easily send all of them:

% tar cf - **/new/*(.) | zstdmt | nncp-file - remote.node:feeds-`date -Iseconds`.tar.zst
% feeder/dir/contrib/feeds-oldenize.zsh

Unlike r2e, feeder has also enclosures and WARCs downloading capabilities, that are also stored as a files on the disk.