I don't really understand the problem. If you want to have lots of sex with lots of girls, carry on.
If you want a partner of quality, you have to BE someone of quality. Inside AND out, as Cam said. I think you are just to willing to take whatever comes your way. Be a bit more selective; if a woman isn't what you want, then be willing to wait.
You didn't answer my question about your wife. You aren't sabotaging yourself about what happened, are you?
Second thoughts can generally be amended with judicious action; injudicious actions can seldom be recovered with second thoughts.
--Cyteen by C.J.Cherryh