Mar 30, 2025

Switched the hashmap heads back to modulo truncation today, so got granular control over sizing. Ran a mini milestone run with all hashmaps LF 1.5 (previous points table was 2.446). This change was projected to reduce search to ~25% of previous, and after this run I measured an average rate of 0.14% vs. 0.53% with the higher load factor, so right on. This also drops the late stage LF by the same amount, so from 1.1% of inserts, to 0.29%. This is significant, and all comes at the cost of increasing the heads by 2.2GiB. We won't see the impact of that until tomorrow morning. The total head size for validation will be 18.2GiB, whereas in yesterday's high LF run it was 16.0GiB. The earlier run that bogged down with a 1.22LF was too big, at 24GiB heads. So I'm hopeful that this will be much better, but in any case we should be able to squeeze enough out of the heads to get to yesterday's 16.0GiB if we have to, and that will certainly be good.