If none of you say anything or make their presence known, they'll get bored and stop.
Just block and report them when you see them.