"Scammed?" You are the boss of you. If you don't go to bed with him, if you only have a cup of coffee with him to see how you click in person, then how do you believe he COULD scam you even if he was trying.
Drive your own car and meet him at your local coffee shop so that you can exit stage left at your control and he doesn't know where you live.
If you like one another and he calls you for an actual date when he gets back from what ever or who ever he is doing on the weekend, then keep the control and don't give into any lust you have for him until you know 100% for sure that he's not married.
Its not so hard when you be the boss of you and refrain from letting others take control of you and over ride any of your good decisions and boundaries.
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion