Deliberately; intentionally. Also 'accidentally on purpose,' meaning seemingly accidental but actually deliberate.
Examples:
- He left the photo out of the story on purpose.
- She stepped on his foot accidentally on purpose.
Origin: Among earliest uses in Shakespeare's The Comedy of Errors (4:3)