He finds them a little annoying from past events, but won't go out of his way to attack one unless they provoke him enough times.
Basically, don't test his patience or you'll regret it.