Is there a way to show/hide a panel on the landing page?

Senario

I have a page set up using the advanced self service portal customization.  I created a "quick Links" section which is basically panels containing a sub panel with an image and text stacked, and that whole sub panel is a link to an offboard template as seen below.

Ideally, I would like to hide this panel if a user is not part of the Manager's group.  This would be far cleaner than restricting access to the template like I have as that just gives a "Template not found" error and makes it look "broken" to end users.  I have looked at scripting options and the like, but could not find anything that may work for this.  I also, have no idea how to get the panel name if I was to find a script to do what I need.

Thanks for the assist!!!