Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Terence Eden
Terence Eden
@Edent@mastodon.social  ·  activity timestamp 3 weeks ago

🆕 blog! “Stop crawling my HTML you dickheads - use the API!”

One of the (many) depressing things about the "AI" future in which we're living, is that it exposes just how many people are willing to outsource their critical thinking. Brute force is preferred to thinking about how to efficiently tackle a problem.

For some reason, my websites are regularly…

👀 Read more: https://shkspr.mobi/blog/2025/12/stop-crawling-my-html-you-dickheads-use-the-api/
⸻
#AI #api #HTML #scraping

  • Copy link
  • Flag this post
  • Block
Khleedril
Khleedril
@khleedril@cyberplace.social replied  ·  activity timestamp 2 weeks ago

@Edent You are trying very hard, but if there were any discrepancies between your API and the HTML (especially hidden web pages), /that/ is interesting information to people who are out to micro-profile you. They'll take you every which way they can.

  • Copy link
  • Flag this comment
  • Block
Russell Garner
Russell Garner
@rgarner@mastodon.social replied  ·  activity timestamp 3 weeks ago

@Edent ah you are my spirit sibling. Conneg and the power of link rel=alternate has too long been ignored, but we shall rise again

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1-alpha.41 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct