Thanks
@evoskuil. I really like the drivers idea. It gives us some freedom to experiment as well. I went down the rabbit hole of in memory databases, reading a bunch of papers from here -
https://15721.courses.cs.cmu.edu/spring2019/schedule.html
It's amazing how much work is being done in the area. It seems Microsoft's hekaton SQL server engine is doing a lot of excellent stuff.
We can pick some good ideas from these projects, if and when needed.
The drivers approach is really cool. Will give us an easy way to experiment.
Btw, I also ran a small experiment of measuring the amount of data going to disk per second during IBD. Want to plot it on a chart before sharing.