Is this too much of a coincidence?

No, it isn't too much of a coincidence because most fantasy books' plots rely on coincidence. However, I do feel like the plot is a little cliche. If this is to be your story, you'll have to put a MAJOR spin on things or add an amazing twist in order to make it original. Hope this helps a little bit.