yes much smaller but all depends hardware
These are the things that make the library really useful - sorting out all of these platform-specific intricacies. It should be simple to tell the caller whether a batch is going to go down a CPU path or a GPU path. If we have that call, we can override batch config at startup.