Terence Eden
boosted
🆕 blog! “Stop crawling my HTML you dickheads - use the API!”
One of the (many) depressing things about the "AI" future in which we're living, is that it exposes just how many people are willing to outsource their critical thinking. Brute force is preferred to thinking about how to efficiently tackle a problem.
For some reason, my websites are regularly…
👀 Read more: https://shkspr.mobi/blog/2025/12/stop-crawling-my-html-you-dickheads-use-the-api/
⸻
#AI #api #HTML #scraping
![[(nginx) mastodon@mastodont:~/bots/nginx$ python nginx.py 1
Base de dades nginx_logs ja existeix
Fitxers de log trobats: ['/var/log/nginx/mastodont.cat.access.log', '/var/log/nginx/mastodont.cat.access.log.1', '/var/log/nginx/mastodont.cat.access.log.2.9z', '/v
ar/log/nginx/mastodont.cat.access.log.3.gz', '/var/log/nginx/mastodont.cat.access.log.4.gz', '/var/log/nginx/mastodont.cat.access.log.5.9z', '/var/log/nginx/mastodo
nt.cat.access.log.6.gz', '/var/log/nginx/mastodont.cat.access.log.7.gz', '/var/log/nginx/mastodont.cat.access.log.8.gz', '/var/log/nginx/mastodont.cat.access.log.9.
gz', '/var/log/nginx/mastodont.cat.access.log.10.gz', '/var/log/nginx/mastodont.cat.access.log.11.gz', '/var/log/nginx/mastodont.cat.access.log.12.gz', '/var/log/ng
inx/mastodont.cat.access.log.13.gz', '/var/log/nginx/mastodont.cat.access.log.14.9z']
Processant fitxer: /var/log/nginx/mastodont.cat.access.log
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.1
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.2.g9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.3.9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.4.g9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.5.9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.6.9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.7.9z
Processant fitxer: /var/log/nginx/mastodont.cat.access.log.8.9z
Recess anT fitxer: /var/log/nginx/mastodont.cat.access.log.9.9z](https://mastodont.cat/system/media_attachments/files/115/020/928/573/998/219/original/0c6dda9f85f82817.png)
