You were in a mere 6 month relationship with this guy that was "off and on." Then while you were "off" he gets a girl pregnant...
This guy is a player and he doesn't like you anymore than he likes his daughter's mother. You're both casual sexual relationships to him at this point and this guy doesn't respect himself never mind either of you two. You need to realize that and distance yourself from him and his troubles. An on and off relationship with a baby being concieved in between should tell you all you need to know about how much he does not really care about anyone but himself.
Get away and stay away for good. Get a guy who has no baby momma baggage and who isn't on and off with you. He's not shown you in the least that he values you for a long term committed relationship ... being patient is ridiculous at this point and you don't need to be hearing things that give you hope to stay in the dysfunction.
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion