Wikidata:Tools/Entitybase
Entitybase was started in December 2025 by So9q
We have a telegram group for people interested in the project.
No dependencies on any WMF code.
Features
[edit]- Deduplicated data down to statement-level
- Scales to 1bn+ entities
- Scales to 1tn+ statements
- 100% compatible with the Wikibase data model.
- Supports minio and Ceph as storage backend (WMF already have Ceph running in production) (entities)
- Supports Mysql server and Vitess as storage backend (statements, references, qualifiers, labels/descr/aliases, etc.)
- Uses Valkey for caching (kafka2sse)
TODO
[edit]- Search endpoint
- elasticsearch support in entitybase-orchestrator
- Frontend (adaption of existing is possible with modifications to suit the new APIs)
- Authentication
Code
[edit]All under GPLv3 built with Python from scratch inspired by Wikibase. It uses WikibaseIntegrator by Myst for validation under the hood.
- https://github.com/Entitybasedev/entitybase-orchestrator
- https://dpriskorn.github.io/entitybase-backend
- https://github.com/Entitybasedev/kafka2sse-backend
- https://github.com/Entitybasedev/kafka2sse-frontend
- https://github.com/Entitybasedev/entitybase-test