It is the opposite; quite the reverse. Examples: Is his shoulder hurting?—On the contrary, it's all better. Origin: Late 1300s; 'on' used since mid-1800s