If you have a Court Order or a Separation Agreement allowing you to move the children out of the area then you should follow those terms.
If you don’t have one, or it is silent as to a move, then you should get permission in writing from the father. If the father will not provide you permission in writing, then you can apply to the court for an Order allowing the move.