I've learned not to be a pushover & I'm going to share something with you. Don't say "yes" when you want to say "no" & learn how to speak your mind. It will cause so much of the tension/annoyances in your life to disappear.
The only people who are mad at you for speaking the truth are those people who are living a lie. Keep speaking the truth. Some people believe their own truth, just because they can't handle a person with a borderline personality.