1. Go to Tools>Administration>NotifyMe.
2. With a Critical Event highlighted in the list, click on Edit or Delete.