Passing the miqat for one who does not intend to perform 'Umrah

We went from Jeddah to Ta'if to visit a relative, and on our way we passed by Makkah. We intended to perform 'Umrah when we returned. On our way back from Ta'if to Makkah, we passed the miqat and entered the state of ihram from al-Sayl. Is our 'Umrah valid, if Allah wills, or do we owe anything?
If a person passes the miqat without intending to perform 'Umrah—for example, intending to go to Ta'if—and enters Makkah, then goes out to Ta'if, and intends to perform 'Umrah when returning from Ta'if, there is no blame on him. He enters the state of ihram from al-Sayl, and his 'Umrah is complete.