How AI Is Redefining the Way We Find Content, by @Clearleft:
https://clearleft.com/thinking/how-ai-is-redefining-the-way-we-find-content
Jan :rust: :ferris:
boosted
I'm (slowly, stutteringly) writing a website link checker, purely to get a bit of practice in Rust. (No use of chatbots/LLMs at any point.)
It's got to the point where I have a functional, but buggy, single-threaded site crawler which works a bit like the (perfectly good) W3C Link Checker, but runs in the console.
After bug fixing, I next want to use threading to fetch multiple pages at once, because I rarely get a chance to work with concurrency.
I'm (slowly, stutteringly) writing a website link checker, purely to get a bit of practice in Rust. (No use of chatbots/LLMs at any point.)
It's got to the point where I have a functional, but buggy, single-threaded site crawler which works a bit like the (perfectly good) W3C Link Checker, but runs in the console.
After bug fixing, I next want to use threading to fetch multiple pages at once, because I rarely get a chance to work with concurrency.