#Tag · bonfire.cafe

Very helpfully @coar_repositories have published the outcome of the 'Dealing with #Bots Task Group'. Thanks! This includes a toolkit for #repository managers devised around the phases: Preparation, Protection and Mitigation. Essential reading for any institution with one or more repositories -- or indeed any digital library or archive. Let's bust the abusive bots!

Dealing With Bots: A #COAR Resource for Repository Managers
https://dealing-with-bots.coar-repositories.org/ #repositories #DigitalLibraries #LLMs

George Macgregor

@g3om4c@code4lib.social · yesterday

Dealing With Bots: A #COAR Resource for Repository Managers
https://dealing-with-bots.coar-repositories.org/ #repositories #DigitalLibraries #LLMs

hannah aubry boosted

Random fediverse bots

@botwikirandomfediverse@stefanbohacek.online · 2 weeks ago

SOMEONE TOOK HALF MY SANDWICH. PUT IT BACK NOW. BRENDA IN HR KNOWS WHO YOU ARE.

https://botwiki.org/bot/office-fridge-bot/

#bots #CreativeBots #CreativeCoding #fediverse

Kathleen Fitzpatrick

@kfitz@hcommons.social · 2 weeks ago

@paregorios @jimgroom @hello Yikes. That’s horrible. I’m so sorry. And increasingly infuriated.

Tom Elliott

@paregorios@hcommons.social replied · 2 weeks ago

@kfitz @jimgroom @hello the " #bots" channel in the code4lib slack is just one disquieting revelation after another

Random fediverse bots

@botwikirandomfediverse@stefanbohacek.online · 2 weeks ago

SOMEONE TOOK HALF MY SANDWICH. PUT IT BACK NOW. BRENDA IN HR KNOWS WHO YOU ARE.

https://botwiki.org/bot/office-fridge-bot/

#bots #CreativeBots #CreativeCoding #fediverse

Charlie Stross boosted

Jeff Starr

@perishable@mastodon.social · 2 weeks ago

⚡ Update! Ultimate AI Block List 🤖 Version 1.8 blocks 700+ #AI #bots, now available for robots.txt, Apache/.htaccess, Nginx, & plain-text flavor. v1.8 adds 60+ bots & improves wildcard patterns to match even more. 100% FREE + #OpenSource for everyone 😊 https://m0n.co/aibots

Jeff Starr

@perishable@mastodon.social · 2 weeks ago

Andreas Wagner

@anwagnerdreas@hcommons.social · last month

@rwg I had blocks in the reverse proxy for hard coded user agent strings and IP ranges first. This soon did not help anymore. Presently I have deployed an anubis proof-of-work container between reverse proxy and backend service and it was really easy (I am no using any special config). I now have a tenth of the scraping requests in comparison with before, i.e. two per minute make it through to the backend whereas before it was about 20 (really very rough estimate). If scraping traffic increases again, I'll try and see how easy it is to set up iocaine.

But this all is for a backend that is not very robust and tolerant of many parallel requests. It sounds like your system, by contrast, can take a fair bit of scraping traffic. Then, I would either just not do anything or consider iocaine if I felt I just wanted to push back a bit as a matter of principle.

Andreas Wagner

@anwagnerdreas@hcommons.social replied · last month

@rwg if you feel like that might be your crowd and platform, there is a nice and busy #bots room on the #Code4lib slack.

SinMisterios

@sinmisterios@mastodon.uy · last month

@j3j5 @santiago Bue tonces si no hay data, se especula. Yo calculo que 2025 la etiqueta más usada de @santiago debe ser #yameiba y la del 2026 #arandelas.
La mía debe ser #puzzle
@j3j5 la tuya será #bots o algo así?

Julio J.

@j3j5@mastodon.uy replied · last month

@sinmisterios @santiago no sé, me voy a tirar con #NowPlaying, que creo que este año la usé más que #botsgüenos (o #bots).

https://mastodon.uy/tags/botsg%C3%BCenos

Julio J.

@j3j5@mastodon.uy · last month

RE: https://oisaur.com/@renchap/115722957498468670

@sinmisterios @santiago sí, los desarrolladores de Mastodon no han llegado a tiempo para ponerlo en una versión "oficial" este año, se supone que va a estar incluido en la versión 4.6 que saldrá para Marzo del año que viene, así que (si esta vez cumplen, porque el año pasado dijeron algo parecido), lo tendremos para el año que viene

Aquí lo explica un poco más el CTO

SinMisterios

@sinmisterios@mastodon.uy replied · last month

Esther Payne :bisexual_flag: boosted

ansuz / ऐरन

@ansuz@social.cryptography.dog · 3 months ago

I just published a blog post summing up my most pertinent thoughts about dealing with badly-behaved web-scraping bots:

https://cryptography.dog/blog/AI-scrapers-request-commented-scripts/

It isn't exactly a Hallowe'en-themed article, but today is the 31st and the topic is concerned with pranking people who come knocking on my website's ports, so it's somewhat appropriate.

#infosec #bots #halloween #scrapers #AI #someMoreHashtagsHere

AI scrapers request commented scripts

A new avenue for identifying greedy, badly-behaved bots

Joel Michael boosted

Neil Craig

@tdp_org@mastodon.social · 2 months ago

3% of requests to www.bbc.co.uk & www.bbc.com have a `user-agent` of OKHttp.

Part of that 3% is a single IP in Turkey which is making nearly 3 million request per day using OKHttp on it's own.

Being on the internet is fun.

#WebStats #WebDev #BBC #Bots #WhoRuinedTheInternet

Neil Craig

@tdp_org@mastodon.social · 2 months ago

3% of requests to www.bbc.co.uk & www.bbc.com have a `user-agent` of OKHttp.

Part of that 3% is a single IP in Turkey which is making nearly 3 million request per day using OKHttp on it's own.

Being on the internet is fun.

#WebStats #WebDev #BBC #Bots #WhoRuinedTheInternet

Grégory Gutierez 🌻🎸🐧 boosted

William Lindsey :toad:

@wdlindsy@toad.social · 2 months ago

"Musk’s latest feature on X has had some shocking and unintended consequences.

Starting Friday, X users were able to use a new 'about this account' feature to see what country accounts were based in. And for many 'America First' posters, this revealed an inconvenient truth…."

Namely that many of these MAGA accounts operate from Russia, Nigeria, India, Thailand, and other countries….

~ Rachel Kahn

#trolls #MAGA #bots
/1

https://newrepublic.com/post/203562/maga-trolls-elon-musk-x-new-feature

The New Republic

Many Top MAGA Trolls Aren’t Even in the U.S.

Elon Musk’s new X feature has been very revealing.

William Lindsey :toad:

@wdlindsy@toad.social · 2 months ago

"Musk’s latest feature on X has had some shocking and unintended consequences.

Starting Friday, X users were able to use a new 'about this account' feature to see what country accounts were based in. And for many 'America First' posters, this revealed an inconvenient truth…."

Namely that many of these MAGA accounts operate from Russia, Nigeria, India, Thailand, and other countries….

~ Rachel Kahn

#trolls #MAGA #bots
/1

https://newrepublic.com/post/203562/maga-trolls-elon-musk-x-new-feature

The New Republic

Many Top MAGA Trolls Aren’t Even in the U.S.

Elon Musk’s new X feature has been very revealing.

Codeberg

@Codeberg@social.anoxinon.de · 2 months ago

@kkarhan @Erpel However, it's the open Internet we're talking about. As such, I hope that it's understandable that we can't guarantee that we can keep your code 100% safe from getting scraped by third parties. ~n

Kevin Karhan :verified:

@kkarhan@infosec.space replied · 2 months ago

@Codeberg my problem ain't #scrapers - otherwise I'd #SelfHost my stuff in my own home LAN - but rather #bots flooding #Issues and #PullRequests with garbage.

Cuz I do expect #bots to scrape #FLOSS which I permissively licensed...

The problem I dread is once people start abusing their " #AI" #bullshit and #FloodTheZoneWithShit aka. " #AIslop" for no good reason.

Kinda like @bagder had to deal with "AI" slop #SecurityReports that didn't even try to show #ProofOfConcept or actually evidence their claims in a scientifically reproduceable fashion but merely wasted lifetime of maintainers!

And @Erpel 's original issue is just that: #spam in the #IssueTracker...

Kevin Karhan :verified:

@kkarhan@infosec.space · 2 months ago

@Erpel because the spammers are assholes?

I wished @Codeberg had some #AI #bot / #blocklist feature to flatout block #spammers and #bots cuz given the fact that #GitHub refuses to allow blocking #Copilot, this may be the straw to move the projects over there if I can't be assed to #SelfHost and merely abude GitHub as a #CDN!
Which I certainly would intent…