Your boyfriend's behavior is called gaslighting. Do you know what gaslighting is? Gaslighting is a manipulative tactic people use to make their partner question their own sanity during confrontations. Some people are extremely good at it and can make anyone feel crazy, or in the wrong, even if the other person did horrible things. Here's a website you can look at to learn more about it: http://www.loveisrespect.org/content/what-gaslighting/
You should be with someone who knows how to communicate respectfully and who is able to navigate relationships in a calm, mature, respectful way. Even if you bring this to his attention, he will likely deny that he acts this way and your problems will never be resolved. Your best bet is to probably break up with him. That's most likely not what you want to hear, but I promise you these are red flags, and those red flags will turn to SOS flares pretty soon. The thing about manipulative people is their behavior never changes. They simply find new ways to manipulate people because they do not know how to achieve the results they want any other way.
"Caring is not an advantage."