Bitcoin full node and query server

Jun 28, 2026

View in context in the libbitcoin Slack #general mirror.

Kevin Ravensberg21:14
Also Claude managed to crash itself hehe, by libbitcoin taking all the free system resources
42 replies · evoskuil, Kevin Ravensberg · last Jun 29, 2026
evoskuil00:25
Taking "free" resources can't hurt another application, because those resources are free.
evoskuil00:30
Clod must have some assumptions about how quickly it can get things, since those things are always available, apart from a disk being full. That implies a race condition.
Kevin Ravensberg00:43
I know that forcing the other apps into swap file on disc will hurt their performance. So it is good to leave a little of it (1~2%) free.
evoskuil00:45
That of course is the fundamental job of the operating system, and it does this. I am performing a full validation sync right now on this machine. Shows 100% CPU and RAM is 116GB used and climbing. It will hit almost 256GB (the physical RAM) and the machine will continue to be responsive - less so than normal, but that's intended.
(edited)
Kevin Ravensberg00:46
My OS is microslop indeed 😂
evoskuil00:46
I'm on Windows. It's far better than macos in this regard, and much better than Linux, as it properly dynamically manages these resources.
(edited)
Kevin Ravensberg00:48
So 64GB RAM is what is holding my machine back then.
evoskuil00:48
No, I don't know what's the problem. I don't have much info. But I have < 1hr syncs on 32GB minis on Windows.
evoskuil00:50
image.png
Kevin Ravensberg00:50
I'll share the IBD plot when it’s done syncing
evoskuil00:50
64 threads, 100% CPU. 11 yo machine.
(edited)
evoskuil00:51
The IBD plot won't tell me what's going on.
Kevin Ravensberg00:51
For me RAM hits 100% and my OS drive then hits 99% usage (normal is 1%)
evoskuil00:52
Normal when you aren't doing anything on a computer is almost 0 🙂
evoskuil00:52
Normal when you are trying to do something as fast as possible with a scalable impl is 100%
Kevin Ravensberg00:53
True, but OS disc being abused as memory is not normal
evoskuil00:53
It's not being "abused as memory". It's writing blocks to the disk.
Kevin Ravensberg00:54
Blocks go to the external SSD for me
evoskuil00:55
The blocks are buffered in RAM and the oldest accessed pages of that RAM are written in bulk to the disk by the OS as necessary.
(edited)
evoskuil00:55
That tradeoff is entirely decided by the OS.
Kevin Ravensberg00:55
Yeah, it is probably the fasted way to sync still
Kevin Ravensberg00:56
Just a bit janky to use while syncing
evoskuil00:56
With a slow (external) SSD, it will take more time to move block data to the disk to free up memory for other things. The disk becomes a bottleneck.
Kevin Ravensberg00:57
It is the bottleneck indeed
evoskuil00:57
It's not the amount of RAM being used, it's the rate at which blocks are coming in relative to the rate at which they can go out. Your network is much faster than your disk. It's a flow problem.
evoskuil00:58
You can reduce the flow coming in by just reducing the number of peers or the number of network threads.
evoskuil00:58
But the default config assumes you want the sync as fast as possible.
Kevin Ravensberg00:59
Network peaks at 300 Mbps or so
evoskuil00:59
Right, because of your disk.
evoskuil00:59
That's your peak write rate.
Kevin Ravensberg00:59
Yep!
Kevin Ravensberg01:00
I'll smack down some more sats for another Samsung 990 pro
evoskuil01:00
Good man.
Kevin Ravensberg01:01
20x higher write speeds than external SSD
evoskuil01:03
will make a difference 🙂. It's a simple idea. To store the chain coming in at 2.5Gbps you have to be able to write to RAM at 2.5Gbps and when RAM is full you have to be able to write to disk at 2.5Gbps. Otherwise RAM will remain full and the backpressure hits the network.
evoskuil01:04
Of course CPU has to also be able to parse and shuffle data round fast enough to maintain those rates as well, or you become CPU bound.
evoskuil01:04
By moving sigs to the GPU we get a whole new resource to work with!
🔥 1
Kevin Ravensberg01:16
My CPU is bored xD
image.png
😆 1
evoskuil01:59
Yep, so is your network. There's always one bottleneck, and quite clearly that's presently your disk.
evoskuil02:00
That's a solid machine. With a fast internal SSD and 2.5Gbps you'll milestone sync in < 1hr.
(edited)
evoskuil02:04
Full validation sync in the current CPU config should be 5.5-6 hrs.
evoskuil02:05
With GPU sig batching I'd say ~3 hrs.