Michael Granitzer: Distributing a web index is a legal challenge. Over 80 laws across the EU related to content legality, copyright, AI, and others. Currently, data is only distributed under a research license, so no commercial use of the data is possible at the moment.
Discussion
Loading...
Day 2 kicked off with focus on EU’s ambition to have its own search engine.
Search is critical Internet infrastructure. ~“What if Europe only had 2 newspapers?” — @grani
Technically, search engines require a large amount storage and compute. They also require ongoing human infrastructure for ML refinement, operation, legal.
I am not sure how this can be done in a federated way, but @openwebsearcheu is trying.
@openwebsearcheu’s first step in creating a search engine has been indexing the web: crawling the web, reducing the HTML from exabytes to petabytes, then to terabyte slices that are distributed.
The equivalent to Google/Bing webmaster tools for info on its crawl of your site: https://openwebindex.eu/websites/www.jeremiahlee.com?ref=activitypub
Michael Granitzer: Distributing a web index is a legal challenge. Over 80 laws across the EU related to content legality, copyright, AI, and others. Currently, data is only distributed under a research license, so no commercial use of the data is possible at the moment.
European Parliamentarian @alexandrageese examined the US far right’s “attack on knowledge”. She warned about the "industrial censorship complex" false narrative being used to attack freedom of speech.
Article 34 of DSA can help counter, but better option would be for more EU-based tech infrastructure and less dependence on the US Big Tech companies whose leaders have kissed Trump’s ring.
European Parliamentarian @alexandrageese:
We don’t want a "European Google". We want a independent, federation of viable alternatives to Google.