Modifying notification profiles

I have assigned a notification profile to a bunch of servers and defined various criteria for that profile. How can I now modify the criteria to change a single setting?