Ruffle Someone's Feathers

To annoy or offend someone; to cause someone to become agitated or upset.

Examples:

• Calling him a tightwad really ruffled his feathers.

Origin: Mid-1800s