Sexual attraction is so ubiquitous and fundamental, and so often uses words like "handsome," "pretty," "gorgeous," etc. to convey itself, that it's a natural assumption to make.