Black Mark

An indication of censure or failure recorded against someone.

Examples:

  • If you refuse to work late, won't that be a black mark against you?

Origin: mid-1800s