Relationships settle into comfort zones at times. That sounds like what is happening here with you and your bf. The fact that you both acknowledge it and want to make it better is a good thing. Now comes the hard part - breaking out of the apathy you have found your relationship in and making it enjoyable again.
I suggest going out on dates. Make it a point to have a date night or something like that. Plan it into your schedule.
As for the sex life, that goes though phases as well. Ask him to be understanding about it, but then consciously try to keep him excited. There are 3000 ways to go about doing that. Surprise is a very good one. He wants to know that you still want him. Just keep that in the back of your mind.
Good luck.
Brought to you by Dating With Devon!