Dealing with a difficult colleague

Something has got me up in a twist.

So in my team at work things are fine. no dramas.

But in the other team that works on the other side of the floor, there is one guy who comes along every now and then and cracks jokes about me. It's weird. Maybe I'm taking it too personally, but I feel like he is not a nice person to me because I've done something wrong.

For example, last week he came along gave everyone a number randomly and then said that he had ranked everyone in order of who he likes. I was the last in the mix. He said it jokingly of course but I had no idea why.

Then a few weeks back he said "hey <name of our section> team friends, and Hams" - implying that I wasn't included in that.

I dunno what he is trying to do or achieve by it. It's weird.

I would reallyy like to tell his guy to bugger off - or something stronger. It's a stressful role already and i don't need that crap in my work day.

I think it's immaturity or jealousy maybe idk?

I know there is a lot of gossip in that other team. I've made a point of never gossiping. I always keep an open mind and i know for a fact (including this guy I am refering to) that everyone has their own reasons (whether they know it or not) for what they say and do. I am one of them too.

Maybe I am overthinking it a bit too much?