Is it possible to remove certain groups out of the DIRECT SELECTS Group?

I made a couple of groups, but i do not want them all in Direct Selects Groups. to keep my Direct Select organised