My best friend is gay so people accuse me of being it...what should I do?

We are both male. I don't think age matters on this question. So my best friend is gay but we're like brothers and people accuse me of being gay because we're close. We don't like hold arms or anything but we hangout and still have fun with each other. I don't get why people would accuse me. They all are people who I don't know who p it onto my friends (who don't care because they're also friends with him) and my friends tell me. I have a girlfriend and I asked him when he came out "I hope your not trying to make a move on me, are you?", and he replied no. He doesn't seem like he is into me either but it's more like i said before of a brotherly thing! What do I do?