It's okay to take a break and don't listen to the person, they are just trying to make you feel bad for their own amusement