Is there a way to select specific users?

Instead of picking only OU's, can I select or decline certain users from using the tool? All of our users are in one giant OU, and there are some I would like to exclude.