I think the fastest way to judge an icon set is to look at the "people" icons (or "user" icons). These are the most difficult to get right.

Often, and I wish I had a better description, the people icons look like the symbols you see on men's toilets.

I'd be interested in icon sets which have better solutions for these people icons.