For the rest of one's life; until the very end. Examples: That aria was so beautifully sung I'll remember it to my dying day. Origin: Mid-1800s.