Was he just using me?

It's pretty obvious he was just looking for a hookup. He avoided you when he wanted to when he had someone and then went after you when he didn't.