@decryption FreshRSS supports creating web scraping feeds. Haven't used this, but I have used their similar feature to grab article text for feeds with only snippets
Discussion
![Screenshot of FreshRSS config page, text is:
Type of feed source
HTML + XPath (Web scraping)
XPath 1.0 is a standard query language for advanced
users, and which FreshRSS supports to enable Web
scraping.
XPath for:
feed title
//title
¿ Example: //title or a static string: "My custom
feed"
XPath for:
finding news items
(most important)
Example: //div[@class="news-item"]
Add
rss
•..](https://cdn.masto.host/rubysocial/media_attachments/files/116/520/301/406/940/028/original/505f8c6d888d7e0d.png)
Replies:
15
@decryption I expect you’ve already tried this but…
online services: https://noai.duckduckgo.com/?q=rss+feed+generator&ia=web
self-hosted: https://github.com/search?q=topic%3Arss+self-hosted&type=repositories&s=&o=desc
and thx for posting the Q – I hadn’t thought of doing this & it might “solve” some pain points for me around getting updates from government websites 🤞
@decryption FreshRSS supports creating web scraping feeds. Haven't used this, but I have used their similar feature to grab article text for feeds with only snippets
@willhbr I use FreshRSS already so might give this a shot!
@decryption I built https://rsspls.7bit.org/ for that, and I use it for a handful of sites. Works for sites that send you actual HTML, and not a ball of JavaScript.
@wezm oh cool - I'll check that one out first because I can bug the developer when I'm too dumb to use it properly :)
@decryption Everything you need to hear about is on Capital Brief anyhoo.
@shermozle do they have an RSS feed?
@decryption Nah but my AI was trivially able to write a script to scrape the headlines for my morning briefing.
@shermozle hmmm, $29/m and you don't even get an RSS feed? dogs
@decryption I'm pretty sure there is/was a tool that did this, but I've no idea where I saw it or what it was called. This is a very helpful response.
@andyb there's a bunch of em out there, looks like im going to have to try them all and see which ones actually work
@decryption another option is to use an RSS reader that can monitor Mastodon or social media feeds. That's assuming the AFR post things of use to social media.
@decryption It sounds like they might sell you an RSS feed: https://business.afr.com/content-integrations
@jamesh interesting! maybe i can buy it and sneakily offer it as an undocumented underground perk for sizzle subscribers
