Move on and find another guy. He's giving you signs that he's not interested in you. Also, you mentioned that he responds to you late at night when you're sleeping. He was probably drunk. I've done that sometimes. He was using you as a bootycall I'm guessing.
From the getgo, he doesn't have any respect for your time. Why would you want to be with someone who doesn't respect your time? Text messaging doesn't take that long to do. Even calling takes about 5-10 mins when there's a point. You're basically playing phone tag. Phone tag is a redflag. Means he obviously thinks he is too busy for you.
I will do my best to reply with an educated, humble and honest answer. Ultimately, it is up to you whether you want to listen to my advice or ignore it completely. Sometimes, my advice may be wrong; occasionally, it will be right. Regardless, I want to do my best to give people answers they are seeking.