I've run a few pump tourneys. Do 2 divisions max. Either CZ/NM or Male/Female or 1 qualifier to pro/other divisions. 4 is definitely too many.
How Official Pump Tournaments are Run:
Series of qualifiers, graded by machine score:
Each round is one song, next power of 2 down proceed to the next round...
For example: 12 people enter
12 play random qualifier song, CZ - 8 people move on
8 play first round (1 random song, CZ) - 4 move on
4 play semi finals (1 random song, NM) - 2 move on
2 play finals (1 random song, Remix/Full NM) - 1 winner
This requires few tokens and moves hella quick. A decently organized tournament of this kind will take 12 people about 2 hours (assuming 7.5 minutes per play).
How machine score works in case you care... (also posted by me XD)
Pump Haven::iB::Topic::Song score formula
It doesn't have to work this way, mind you.
Easy modifications:
Have people be disqualified slower:
Instead of 16 -> 8 -> 4 -> 2 -> 1
You could do 16 -> 12 -> 8 -> 6 -> 4 -> 3 -> 2 ->1
Or you could do double-elimination qualifiers... as in, the bottom half of players get a strike against them - two strikes against you and you're out. *shrugs* actually this could work pretty well.