Just see the triangle with the "!" on it that says report at the side. Click and type what each activity is doing wrong, and click the red button, named report, and now the follower will dissapear completely, unable to re-add him.