If the other guy wasn't in the picture would you want to be with "your daughter's father" (funny that you don't even call him your boyfriend/spouse/SO or Ex.)
Is your D's F willing to move out of the depressing basement and find his family their own home?
Is he willing to keep going on date nights with you and courting you instead of taking you for granted once you're back?
Just Some things to consider ^^^
BTW: Did you bring your daughter with you when you packed your bags and left? Its unclear.
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion