Bitcoin full node and query server

May 26, 2019

View in context in the libbitcoin Slack #general mirror.

N
narodnik13:35
I'm syncing testnet and according to block explorers, it's currently 1.5 million blocks long... at the rate I'm syncing it will take approx 1 month to fully sync. why hasn't testnet been reset? damn the chain is too long for testing.
38 replies · neillm, narodnik · last May 27, 2019
neillm00:58
I usually start a full testnet sync in the evening and it's done by the next day. Is the limiting factor at the moment the bandwidth available or disk? A month seems rather excessive.
neillm00:59
This does assume using an ssd -- I haven't tested on spinning disk in some time, but used to do that regularly in the v2 days.
N
narodnik11:38
Weird, I am on an SSD with a laptop
N
narodnik11:46
It seems limiting factor in this case is the disk
neillm11:47
I've had laptops with rather slow SSDs, likely slower bus speeds. But a month still sounds quite unreasonable for testnet. Mainnet in a bad case shouldn't take longer than that 🙂
neillm11:48
v3 or v4? Shouldn't matter at that kind of timeframe, but just curious
N
narodnik11:48
v3
neillm11:48
Ok, and still having the shutdown issue between attempts?
N
narodnik11:48
v4 has a problem for me where it doesn't stop. I leave it for several hours and it's just hanging
N
narodnik11:48
yep
neillm11:49
That's unfortunate. The only difference on my current setup is that I'm running a modified protocol and server, based on these PRs: https://github.com/libbitcoin/libbitcoin-protocol/pull/202
neillm11:50
It's possible there is web code causing a hang that was resolved in there a while ago, but I don't recall anything like that.
N
narodnik11:50
That's a good PR
neillm11:51
Thanks! It's been useful for testing here. Still some unknowns on how to handle the default content, but it's a start
N
narodnik11:52
It's good websockets have been added, maybe even more useful than ZMQ. Still it's a shame ZMQ itself didn't add websockets as a protocol option. It's been a lingering request for years.
neillm11:52
Interesting, I didn't know that was on the table.
neillm11:54
Agree though, that ZMQ is the better way to go generally, but these days, it seems almost everyone knows websockets via browser js or node.js
neillm11:55
In any case, you're welcome to give those branches a test build and see if it resolves the start/stop issue. I'm fairly certain when I re-build vanilla v4 master, it doesn't hang, but it's been a while. I have a pile of outstanding PRs I've been testing with lately
N
narodnik11:56
my plan is to get a server and set it up for testing
N
narodnik11:56
then others can login too
neillm11:57
Ah, something like that could be good, or chaotic 😉
neillm11:59
Oh, about the hang -- static or shared library build?
N
narodnik12:00
shared, I built it locally
N
narodnik12:00
manually myself
neillm12:00
I've seen a hang using a shared library build because of something related to boost on ubuntu that I was unable to resolve. Statically linking to boost worked on that machine, but I couldn't determine why it was hanging inside of boost otherwise
neillm12:01
Gdb would consistently trap it at the same spot in some innocuous boost code on shutdown.
N
narodnik12:01
when I get time I will try to look where it's hanging
neillm12:01
Thanks, am curious if that has come back
N
narodnik12:01
i'm on arch
neillm12:02
I don't know that it was specific to ubuntu, but a user reported it on ubuntu and I setup a VM for testing, and was able to replicate it
N
narodnik12:03
there should be a stop() call in the blockchain anyway
N
narodnik12:03
(if that's what's causing a slow shutdown)
N
narodnik12:07
no idea I didn't check
N
narodnik12:08
ah ok there is a stop() method, right
neillm12:09
If the shutdown hang isn't like that odd boost one I was seeing, I am curious if there's a locking issue on shutdown that I'm just getting lucky on and not seeing
(edited)
neillm12:10
I almost always build statically these days too, so am curious if that will help for now. If you get a chance, give that a shot