To produce the Stealth Secret you needed both the Scan Secret (from your wallet) and the EPK which is generated from the ES which is created by the payer. The EPK is stored in the tx.op_return. So I don't see how you have it if you haven't scanned for it.