Rub The Wrong Way

To irritate or annoy someone.

Examples:

• His remarks about welfare rubbed a great many people the wrong way.

Origin: Mid-1800s; alludes to rubbing an animal's fur against the grain