@yphil That site is taking a long time to load the actual content, so when it thought it was done loading, it actually only consisted of
<div id="app"><div class="main--empty"></div></div>
I've pushed a new version that should fix that. Should be released when the following build is done: https://gitlab.com/vincenttunru/feed-me-up-scotty/-/pipelines/332733174
@VincentTunru Wow, that was quick, thanks! From what I understand, the code runs "remotely" on your repo (mine only containing feeds data/params) but I just ran the pipeline again, w/o luck, so I must be missing something? :(
@VincentTunru Is feed-me-up-scotty hard-configured to target a branch named "main"? That could be what I ran into ; still investigating why the jobs all say "main" (https://gitlab.com/yphil/solexine/-/jobs) even though I configured the schedule (https://gitlab.com/yphil/solexine/-/pipeline_schedules) to target "master"..?
@VincentTunru I just tested again(& reseted the fork to work w/ the main branch, so I'm pretty sure I'm up-to-date)) no luck, my feed is still empty :( so I guess it must be my selectors... Are you able to generate a feed from an Odysee channel yourself? If yes, I'd love to see the selectors you use :p
@VincentTunru YAY it works now 😎 w/ your selectors!! The link is OK ; The thumbnail image is the icon of the channel so no image, I guess ; still, Vincent, you are now officially one of my personal HEROES :)
@yphil Great to hear! I just looked at adding an imageSelector, but unfortunately there's a bit more variance with some sites having regular <img>s, some having a background-image somewhere, and possibly srcset and the likes. I'll think about that some more.
@VincentTunru But... It's the same as the other selectors, only both - admittedly - harder to find / scrap & much less critical: if the selector isn't found, then it's not found, no biggie, and if it's not even present in the feeds.toml file, same! Am I missing something ?
Dude, this project is fantastic, do you have a crowdfunding url set up? I mean, as we say in France "c'est mal vendu" (this is so hard to find that it's not really for sale) 😋
@yphil Well, no, not really, but in the Odyssee page you linked, the images aren't a regular <img>, and I was hoping to support at least your use case :) I'll definitely add support for regular images, but I'll try to support background images as well.
And no, there's nothing to fund: I'm privileged enough to be able to work on things like this, and am scratching my own itch and enjoying myself when doing so, so I wouldn't feel comfortable taking people's money.
@yphil OK, so, I got image detection working, but... It turns out Atom feeds don't support images for individual feed entries. 😭
@VincentTunru But... What about this atom feed ? https://linuxfr.org/news.atom See it rendered w/ item imgs: http://petrolette.space/?add=https://linuxfr.org/news.atom ?
@yphil The individual feed entries there don't have specific references to images either, as far as I can see. I think Petrolette just takes an image referred to in the content and uses that as cover image?
@VincentTunru Thanks for sharing this, this is a very nice idea that makes an otherwise cumbersome task very easy!
One thing I've had to deal with writing HTML to RSS converters was that often it'd require some ad-hoc modification of the content you grab with selectors. e.g. there will be variation from item to item, dates will be absurd, they'll add a flashing "new" GIF as if it was the 90s, etc. In some other cases, the feeds will be much more useful if postprocessed, e.g. files can be made to enclosures, URLs could be cleaned up, etc.
In that light a scripting feature could make this tool even more powerful. IDK if it'd be possible to make the DOM available to the user, but even if it was just a random executable script with HTML in its stdin, a lot can be achieved say with Nokogiri in a Ruby script. E.g. these scripts here are for my university's announcements https://gitlab.com/cadadr/hacettepe2rss which can demonstrate how some feeds may require postprocessing.
@cadadr Yeah I can see the use case. I think the best approach in that case is to set up your CI job to execute the post processing script after Feed me up, Scotty! completes, and processes the generated feed rather than the HTML. Or alternatively, to just create a fork — it's a relatively small script.
Could you link me an example webpage?
I'd like to see how it looks/feels. :)
@paulfree14 The homepage shows an example config and below that links to the generated feed (and contains a screenshot of those feeds rendered).
So the "Did you know?" section on the Wikipedia homepage can be turned into this feed: https://vincenttunru.gitlab.io/feeds/funfacts.xml (plug that into a feed reader to see what it looks like)
I think Feed me up, Scotty! is mainly useful if you prefer having it in a place under your control without needing to run your own server, e.g. GitLab CI/CD or GitHub Actions.
@tio @jpfox Yes, see my other reply: https://fosstodon.org/@VincentTunru/106550693094770379
The linked Hacker News thread contains lots of suggestions. I'm sure one of those will suit your need!
@VincentTunru sounds pretty cool ! Thanks !
oh and btw, if you rotate your logo 135degrees the wave will kinda look like a styized “F” like your tool’s name
@Guerin Ha, I was going for an imitation of a UFO beaming up a person, but a stylised "F" is a fun idea too 😃
Fosstodon is an English speaking Mastodon instance that is open to anyone who is interested in technology; particularly free & open source software.