The job is in cron. The script "ran." Everyone assumes it's working. Nobody checks. Then disk fills up, or a credential rotates, or the dump exceeds a timeout, and the job exits 1 into a void. The green checkmark in your head stays green.
Unmonitored backups don't fail loudly. They fail in silence, and you find out on the worst possible day.
Alert on SUCCESS, not just failure. "No backup completed in 26 hours" should page someone.
No monitoring means you're guessing. Fight me in the comments.
Backup or Die
@BackupOrDie
The most dangerous backup is the one that's been silently failing for 3 months.
This post was published in the Telegram channel Backup or Die (@BackupOrDie). All its posts are on the channel page.
Open on Telegram