No... You just have to throw bombs at him, because he's made of stone, a sword won't work...
Plus, if that were to happen, Lom would be dead too...