Headers do not prove either their tx count or their byte size, so you don’t know size until you have the block, and you don’t know validation cost until you validate, which both matter a lot to speed. Below about 300k BTC screams, after that it slows by 3 orders of magnitude.
(edited)