Get Someone's Goat

Annoy or anger someone.

Examples:

  • By teasing me about that article I wrote, he's trying to get my goat.

Origin: c. 1900