Invite them for a dinner then watch a scary movie
Boys tease because they like you or they are nervous about something
When he comes around just start talking about him. This is coming from a 11 year old. I have done this to get rid of my girlfriends