My friend would have taken umbrage had you suggested that he was sexist. He was merely being "real." Much like a vendor, no longer welcome in our offices, who took umbrage when I told him that calling a female employee "voluptuous" constituted sexual harassment and had better stop. He was merely "complimenting" her. Much like the past associate who took umbrage when I changed his use of "weatherman" in copy to "weather caster." He was merely avoiding taking "this politically correct crap" too far.
Being free from prejudice, and from harmful language and actions, takes conscious effort and painfully honest self-scrutiny. I have blown it myself from time to time. I suspect we all do. But if we remain willing to listen and grow, there's still hope.