I don't see a problem here, except you might be too uptight. Just lock the door, make sure no unannounced visitors barge in. As a parent, that's what I did. And we did our activities when the kids were outside or sleeping. But we always locked the bedroom door.
I have a long time interest in psychology, specializing in relationship dynamics for 30 years.
(Please note, we give the best advice we can based on the information given in a post. For better advice, please include the age of all romantic partners.)