The minimal details (comparable to existing benchmarks) take less than 100ms. The above includes not only all payments to an address, but all spenders of the payments (of they exist) and all tx/block details for the output and input and their txs/positions and blocks/heights. Spenders is an expensive reverse index, similar to the payment address search itself.
(edited)