Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
IEEE Spectrum
@ieeespectrum@mastodon.social  ·  activity timestamp 4 weeks ago

Today, Cloudflare reported that the AI company #Perplexity is using "stealth crawlers" to scrape data from websites with no-crawling policies. Read about how AI has created a battle over web crawling in this Q&A: https://spectrum.ieee.org/web-crawling

  • Copy link
  • Flag this post
  • Block
Log in

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.0-rc.2.11 no JS en
Automatic federation enabled
  • Explore
  • About
  • Members
  • Code of Conduct