In the Recurring Alerts section each Message and Recurring Alert will have a pencil icon and trash can icon to the right of the recurring alert.
Click on the trash can and you will be asked to confirm the deletion.