up and running, might need to do some param tuning but so far seems to be chugging through. this is 1gbps , but im requesting a 10 gbps link for this box
The engine should be controlling the batch size that the GPU sees. What we send gets chunked up internally. So it really should not matter if the batch we send is large.