Is he taking advantage of me..?

honey, try staying away from the touching and others to see if he makes any remarks about it. then you can respond by saying you feel left out by him not making moves. if he doesn't mention that he misses you then you'll know he's not serious