Discussion
Loading...

#Tag

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Brett Sheffield (he/him)
Brett Sheffield (he/him)
@dentangle@chaos.social  路  activity timestamp 4 weeks ago

Dreamed that someone in #gentoo had put out an announcement about @librecast saying that we used mjolnirdb for our test data, which I'd never heard of.

I just had to check. There is no mjolnirdb. I usually use #lmdb (or #sqlite if we need a SQL interface) 馃槈

  • Copy link
  • Flag this post
  • Block
Esther Payne :bisexual_flag: boosted
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp last month

Multi-Scale Fusion for Object Representation

"Representing images or videos as object-level feature vectors, rather than pixel-level feature maps, facilitates advanced visual tasks. Object-Centric Learning (OCL) primarily achieves this by reconstructing the input..."

"To speed up experiments, ... converting all datasets into the #LMDB database format and storing them on an NVMe or RAM disk to reduce I/O overhead and maximize throughput."

https://arxiv.org/html/2410.01539v3

Multi-Scale Fusion for Object Representation

  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp last month

Multi-Scale Fusion for Object Representation

"Representing images or videos as object-level feature vectors, rather than pixel-level feature maps, facilitates advanced visual tasks. Object-Centric Learning (OCL) primarily achieves this by reconstructing the input..."

"To speed up experiments, ... converting all datasets into the #LMDB database format and storing them on an NVMe or RAM disk to reduce I/O overhead and maximize throughput."

https://arxiv.org/html/2410.01539v3

Multi-Scale Fusion for Object Representation

  • Copy link
  • Flag this post
  • Block
Pascal and 1 other boosted
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 2 months ago

Looks like you can earn far more from using #LMDB than I ever got for writing it...

Sorry, no caption provided by author
Sorry, no caption provided by author
Sorry, no caption provided by author
  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 2 months ago

Looks like you can earn far more from using #LMDB than I ever got for writing it...

Sorry, no caption provided by author
Sorry, no caption provided by author
Sorry, no caption provided by author
  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 2 months ago

A discussion of using many embedded DBs to "shard" a larger logical DB. https://xcancel.com/iavins/status/1979906198301249745

Most of the responses are like "wow what a revolutionary idea" but in fact ActorDB has been doing this on top of #LMDB for over 10 years already. https://blog.biokoda.com/post/133121776825/actordb-how-and-why-we-run-sqlite-on-top-of-lmdb

Seriously, this industry's attention span is pathetically weak.

  • Copy link
  • Flag this post
  • Block
Alan Zimmerman boosted
fresco
fresco
@frescosecco@mastodon.social  路  activity timestamp 5 months ago

A high-performance Erlang NIF (Native Implemented Function) for LMDB (Lightning Memory-Mapped Database) written in Rust.
https://github.com/twilson63/elmdb-rs
#Erlang#LMDB

  • Copy link
  • Flag this post
  • Block
fresco
fresco
@frescosecco@mastodon.social  路  activity timestamp 5 months ago

A high-performance Erlang NIF (Native Implemented Function) for LMDB (Lightning Memory-Mapped Database) written in Rust.
https://github.com/twilson63/elmdb-rs
#Erlang#LMDB

  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 5 months ago

A new engineer discovers how Cloudflare used #LMDB for their distributed config https://xcancel.com/UltraSive/status/1948967694004326605#m

"99th %ile of reads dropped by two orders of magnitude!"

"LMDB stability has been exceptional. It has been running in production for over three years. We have experienced only a single bug and zero data corruption. Considering we serve over 2.5 trillion read requests and 30 million write requests a day on over 90,000 database instances across thousands of servers, this is very impressive."

Gabriele Svelto
Gabriele Svelto
@gabrielesvelto@mas.to replied  路  activity timestamp 5 months ago
@hyc#LMDB is great and I wish we could use it more
  • Copy link
  • Flag this comment
  • Block
Gabriele Svelto boosted
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 5 months ago

A new engineer discovers how Cloudflare used #LMDB for their distributed config https://xcancel.com/UltraSive/status/1948967694004326605#m

"99th %ile of reads dropped by two orders of magnitude!"

"LMDB stability has been exceptional. It has been running in production for over three years. We have experienced only a single bug and zero data corruption. Considering we serve over 2.5 trillion read requests and 30 million write requests a day on over 90,000 database instances across thousands of servers, this is very impressive."

  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 5 months ago

A new engineer discovers how Cloudflare used #LMDB for their distributed config https://xcancel.com/UltraSive/status/1948967694004326605#m

"99th %ile of reads dropped by two orders of magnitude!"

"LMDB stability has been exceptional. It has been running in production for over three years. We have experienced only a single bug and zero data corruption. Considering we serve over 2.5 trillion read requests and 30 million write requests a day on over 90,000 database instances across thousands of servers, this is very impressive."

  • Copy link
  • Flag this post
  • Block
Howard Chu @ Symas
Howard Chu @ Symas
@hyc@mastodon.social  路  activity timestamp 6 months ago

Investigate #LMDB as HLR storage
https://projects.osmocom.org/issues/3649

This Open Source Mobile Comm project appears to be an open source impl of a 3G network's backend software. But they're not using the standard 3GPP protocols, they're using their own home-grown stuff instead.

Looks like a toy, using SQLite3 as its HLR storage. Real 3G/4G networks use LDAP, lots of OpenLDAP in particular because nothing else scales enough, efficiently enough.

  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About 路 Code of conduct 路 Privacy 路 Users 路 Instances
Bonfire social 路 1.0.1-alpha.40 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct