Yes! He doesn't want her to feel like she's "won" by getting under his skin. He absolutely does want her to reciprocate -- desperately, in fact -- but he's not willing to be that vulnerable with her if he can help it (which he sometimes can't -- it mostly comes out in little ways).