Combinatorial categories and permutation groups