You need to make money to survive. Working is a means to an end. Family/Relationships come first, but you need money to survive. You did nothing wrong because you need to pay the debts to function in society and you are part of that society.
I know that it sucks, but we need money for the most basic needs. Relationships are important, but in order to have a relationship, you do need money.
I will do my best to reply with an educated, humble and honest answer. Ultimately, it is up to you whether you want to listen to my advice or ignore it completely. Sometimes, my advice may be wrong; occasionally, it will be right. Regardless, I want to do my best to give people answers they are seeking.