Just calmly tell then that you know what's going on. If you don't like them you don't have to do anything. Just make them jealous that they're not with you anymore~