Remove support group for one site

Remove support group for one site

Hello,

Due to having set one of our sites to ' Copy Default Settings' all the support groups are added to this site. This is not needed because only one specific group should be set for that site. 
I've switched it to Custom Settings, but when i go to support groups and go to that specific site and delete a support group, they are deleted everywhere.
Is there a way to delete the support group from one specific site?

Regards
Kenneth

                  New to ADSelfService Plus?