I’m shocked I had never seen sqlit until today https://terminaltrove.com/sqlit/
Pretty cool terminal #database client that has strong lazygit vibes.
#ReleaseSaturday — This week I've been working on extracting, refactoring & generalizing the minimal column store database I've been using for my personal knowledge/media management toolset, and I'm happy to share it with the world now:
This is an in-memory column store database with:
- Customizable column storage types with configurable min/max cardinality, support for optional and/or tuple-values, default values
- Support for custom column type implementations
- Optional dictionary encoding of column values (memory & filesize saving)
- Powerful extensible multi-term query engine with built-in OR/AND/NOR/NAND operators and predicate-based matchers (column, row, partial row). Queries can be pre-built and then executed as standard JS iterables
- Optional bitfield indexing for dramatic query acceleration (esp. for complex multi-term queries)
- Dynamic adding/removing of columns
- JSON serialization with optional RLE compression (in my PKM dataset with ~20k items, the RLE compressed version is only 29% of the normal JSON serialization)
I hope the readme and code examples give a decent overview for now... I've been using the overall system for a couple of years now, but this new packaged version is still marked as _alpha_. Everything's still being worked on.
Also, for those wondering what's the point of this all and why not using SQLite etc. — I find there're many use cases for a which a pure JSON-based approach is more than sufficient (without requiring extra tools and interfacing layers). The structure/storage model and the bitfield optimizations enable very fast query performance (compared to other JSON db's I've tried in the past)...
(Including all dependencies [only some other thi.ng packages], the entire DB package is ~6KB brotli'd, 19KB uncompressed...)
#ThingUmbrella #TypeScript #JavaScript #JSON #Database #QueryEngine #RLE #SmallWeb
#ReleaseSaturday — This week I've been working on extracting, refactoring & generalizing the minimal column store database I've been using for my personal knowledge/media management toolset, and I'm happy to share it with the world now:
This is an in-memory column store database with:
- Customizable column storage types with configurable min/max cardinality, support for optional and/or tuple-values, default values
- Support for custom column type implementations
- Optional dictionary encoding of column values (memory & filesize saving)
- Powerful extensible multi-term query engine with built-in OR/AND/NOR/NAND operators and predicate-based matchers (column, row, partial row). Queries can be pre-built and then executed as standard JS iterables
- Optional bitfield indexing for dramatic query acceleration (esp. for complex multi-term queries)
- Dynamic adding/removing of columns
- JSON serialization with optional RLE compression (in my PKM dataset with ~20k items, the RLE compressed version is only 29% of the normal JSON serialization)
I hope the readme and code examples give a decent overview for now... I've been using the overall system for a couple of years now, but this new packaged version is still marked as _alpha_. Everything's still being worked on.
Also, for those wondering what's the point of this all and why not using SQLite etc. — I find there're many use cases for a which a pure JSON-based approach is more than sufficient (without requiring extra tools and interfacing layers). The structure/storage model and the bitfield optimizations enable very fast query performance (compared to other JSON db's I've tried in the past)...
(Including all dependencies [only some other thi.ng packages], the entire DB package is ~6KB brotli'd, 19KB uncompressed...)
#ThingUmbrella #TypeScript #JavaScript #JSON #Database #QueryEngine #RLE #SmallWeb
For my mobile development course, I'm trying to steer people away from just using Firebase for everything and towards a selfhosted solution (obviously 😉). Last year, I used Pocketbase, because it's just a single drop-in executable and has good Flutter support, and that seemed to work reasonably well, but I'm curious if people have any alternative suggestions? Keep in mind that the students are still relatively early in their bachelor's degree and not very experienced.
I’m shocked I had never seen sqlit until today https://terminaltrove.com/sqlit/
Pretty cool terminal #database client that has strong lazygit vibes.
Scaling PostgreSQL to power 800M ChatGPT users
https://openai.com/index/scaling-postgresql/
#HackerNews #Scaling #PostgreSQL #ChatGPT #800M #users #Database #Performance
Turso is an in-process SQL database, compatible with SQLite
https://github.com/tursodatabase/turso
#HackerNews #Turso #SQL #Database #SQLite #InProcess #Database #TechNews
Unconventional PostgreSQL Optimizations
https://hakibenita.com/postgresql-unconventional-optimizations
#HackerNews #PostgreSQL #Optimizations #Database #Performance #Tech #Tips #HackerNews
2. è allucinante che,la nonostante la brutalità dell' #ICE - tra cui l'uccisione di #ReneeGood - la #CommissioneEuropea sia disponibile a trattare con USA per dare in pasto i #database di #Polizia al #DepartmentOfHomelandSecurity, e quindi all' #Ice
The next-gen SQLite won't look like SQLite
https://gist.github.com/radarroark/03a0724484e1111ef4c05d72a935c42c
#HackerNews #nextgenSQLite #SQLite #evolution #database #technology #innovation
1. Buongiorno,
oggi su #FattoQuotidiano vi ricostruiamo un caso completamente sotto silenzio
UE sta negoziando accesso ai nostri #Dati più scottanti-i database di polizia-con il #DHS, sotto cui opera #ICE
2. è allucinante che,la nonostante la brutalità dell' #ICE - tra cui l'uccisione di #ReneeGood - la #CommissioneEuropea sia disponibile a trattare con USA per dare in pasto i #database di #Polizia al #DepartmentOfHomelandSecurity, e quindi all' #Ice
Elasticsearch Was Never a Database
https://www.paradedb.com/blog/elasticsearch-was-never-a-database
#HackerNews #Elasticsearch #Database #Discussion #Technology #Insights #DataManagement
How SQL Parsers Work
https://nishchith.com/sql-parsers/
#HackerNews #SQL #Parsers #SQL #Programming #Tech #Explained #Data #Parsing #Database
--<--
December 2025 newsletter - 2025 year in review, community widgets showcase
We’ve done a significant redesign of the Grist Help Center (https://support.getgrist.com/) home to our support and developer documentation.
This has been another productive collaboration with Emmanuel Pelletier https://github.com/manuhabitela) !
# GrainJS
We’ve also done some work on the documentation for GrainJS (,https://gristlabs.github.io/grainjs/) a light web framework upon which Grist is built.
GrainJS ( https://github.com/gristlabs/grainjs) always been there, but now you can better understand the frontend powering your spreadsheets – only 30kb and dependency-free!
..
-->--
#grist #logiciellibre #database #web #dinum #javascript #python
--<--
December 2025 newsletter - 2025 year in review, community widgets showcase
We’ve done a significant redesign of the Grist Help Center (https://support.getgrist.com/) home to our support and developer documentation.
This has been another productive collaboration with Emmanuel Pelletier https://github.com/manuhabitela) !
# GrainJS
We’ve also done some work on the documentation for GrainJS (,https://gristlabs.github.io/grainjs/) a light web framework upon which Grist is built.
GrainJS ( https://github.com/gristlabs/grainjs) always been there, but now you can better understand the frontend powering your spreadsheets – only 30kb and dependency-free!
..
-->--
#grist #logiciellibre #database #web #dinum #javascript #python
Readings in Database Systems (5th Edition)
#HackerNews #Readings #in #Database #Systems #DatabaseSystems #5thEdition #TechBooks #HackerNews
Postgres extension complements pgvector for performance and scale
https://github.com/timescale/pgvectorscale
#HackerNews #Postgres #pgvector #extension #performance #scale #database #technology
