I have a machine that is running at very high CPU utilization and it is generating dozens of emails per day. So I decided to temporarily remove the alarm for this test by moving the actions out of the associated actions field. However, I am continuing to receive emails.
Solution: Check out whether the alarm you have got is for the CPU (or for that specific attribute) or for the health of that monitor. Because, the actions might be removed for the CPU (or for that specific attribute) but not for the health of the monitor.