Bitcoin full node and query server

Nov 5, 2024

View in context in the libbitcoin Slack #general mirror.

somewhat unrelated, im very curious what insights you guys have regarding mmap'd db architectures. ive been exploring mdbx as a replacement for leveldb in core as sort of a moonshot side experiment, and mdbx (fork of lmdb) is essentially a mmap'd shadow paged btree. we saw some really promising benchmarks, but also a ton of write amplification. curious if you guys have any insights, since it seems you've rolled your own mmaped db architecture?

evoskuil19:49

Then there's the issues of achieving (1) performant write/write thread safety (as well as read/write and read/read of course), (2) cross-file transactional commit for snapshotting and disk full scenarios (we handle disk full without the need for snapshot/recovery or restart), and (3) global read/write pointer invalidation when any given table requires a remap for expansion.