Would this upset you? Am I being too sensetive...?

Your ex is a self-centered jerk. From what you've posted, I'd say it's time for you to get an attorney. He's trying to make you miserable and there is a precious little girl in the middle. Let an attorney take that to a judge for a decision. I hope you come out a winner in this, and I hope you get to visit with you father.