Why do some people reject compliments? Do you consider it rude to do so?
When you lack enough self-confidence, you will tend to believe compliments are lies. Also what Shannon said about flirting, those can be somewhat shallow if you're doing it out of horniness.
I think it's only rude when the rules above don't apply.
