Post · bonfire.cafe

Post

@awinkler@openbiblio.social · 2 weeks ago

What is in #wikidata? The answer to this question on the Wikidata:Statistics page (https://www.wikidata.org/wiki/Wikidata:Statistics) hasn't been updated for a while. This #sparql query run in #qlever provides a snapshot of the current situation (it's not entirely identical as P31/P279* times out even in qlever but it conveys the idea): https://qlever.dev/wikidata/k9TJoh

Articles have the lion's share, paintings and manifestations of wirtten works are well represented, though.

2 media

The QLever SPARQL engine: fast, scalable, with autocompletion and text search

Wikidata:Statistics - Wikidata

Egon Willigh☮gen 🟥

@egonw@mastodon.social replied · 2 weeks ago

@awinkler in many discussions about these statistics a miss the notion of the scale of the problem. Instead, we discuss the notability of stars, the notion that in many categories, we just capture a small fraction of human knowledge. Wikidata is not ready yet, the technical limitations have enormous social impact, negatively

Alexander Winkler

@awinkler@openbiblio.social replied · 2 weeks ago

@egonw not sure if I get your point. Would you mind explaining what you mean e.g. by scale of the problem and the negative social impact? I do have difficulties accepting that items that meet the notability criteria should not be added to wd because of technical limitations as I hope that graph dbs haven't hit their limits yet. Asking contributers to refrain from adding items or advocating lightheartedly for separate graphs is risky and may be deleterious.

Egon Willigh☮gen 🟥

@egonw@mastodon.social replied · 2 weeks ago

@awinkler yes, that's basically what I mean. The last happens actively.

This left a situation where I experience that people no longer have any idea what is acceptable, slowly creating a wild west where you can only do things wrong.

but another negative impact is that I have to start looking for other solutions. I am not unique, I think. I have the impression a lot of people who did an amazing data curation effort in the past have not recently been empty

Alexander Winkler

@awinkler@openbiblio.social replied · 2 weeks ago

@egonw I wonder if we'd have the same discussion if blazegraph had already been ditched. Interaction with wikidata using qlever is a completely different experience. Even federation is finally proving viable (which would make separte graphs less risky).

Egon Willigh☮gen 🟥

@egonw@mastodon.social replied · last week

@awinkler maybe we are not 😊 Wikidata has not fitched Blazegraph

Afaik, the two WDQS SPARQL endpoints both run (a set of) Blazegraph server(s).

Apart from that, the QLever team runs a single endpoint with all triples, using, well, QLever. That one is actually updated by following the edit stream (details I do not know well enough).

We tried making Scholia queries federated, but it was too complex. Data is split in the wrong way for that

Alexander Winkler

@awinkler@openbiblio.social replied · last week

@egonw I asked the qlever team about the scalability concerns: https://github.com/ad-freiburg/qlever/discussions/2678

The limits wrt RDF shouldn't be a problem if blazegraph is replaced (or if we just started using qlever instead of the wdqs, which is basically what I've been doing for a while now).

The problem with wikibase is more worrying maybe as it concerns every wikimedia project. Provided that wikibase is database-wise as outdated as blazegraph (i don't know the details), I'm not sure if there are alternatives.

GitHub

Qlever's view of Wikimedia's concern with regard to the size of Wikidata · ad-freiburg qlever · Discussion #2678

Wikimedia is worried about the size of Wikidata (cf. this RfC). I'd be interested to know what qlever makes of the described limits concerning the overall size of wikidata and the number of edits a...

1+ more replies (not shown)

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances

Bonfire social · 1.0.2-alpha.7 no JS en

Automatic federation enabled