Nov 5, 2024

So I matched the threadpool thread counts between the validator and the confirmer (configured to 64 on the big box), and dropped the window to 10k. After an hour. archive, validate and confirm are all remaining within (or at least very close to) the download window. The smaller window also improves data locality, but there is of course a tradeoff, since the CPU is not fully utilized. As when each download window starts to close out we always see network underutilization. The same will happen with CPU by more more closely coupling validation and confirm, but the advantage should be significantly reduced paging.