A lot of players do just that. Wife and kids spend the summer with Dad. Ball players move all the time. Lots of them maintain a home somewhere other than where they play so they always have a place to call home regardless of getting traded, release, sent to the minors, etc.