My hesitation on some witness addresses is that I think they are indistiguishable from P2SH or multisig, just by looking at them (could be wrong there). In any case, I don't think that's true of all witness addresses, particularly those that are obvious (bech32 encoded)