Reposted from CH Forum:
We had some good discussion with the designers on our last contest about the process or ranking and rewarding designers for their effort. Now that I've finished a second contest, I have some suggestions for LT on the ranking process that would simplify things for CHs so they don't have to know anything about the point system and won't unintentially offend some designers as I'm sure we did.
The suggestion would be to have 4 bins instead of 3. The 4 bins would be:
1. The New and Unranked Pool (same as now)
2. The Show Pool (a new column with "Receives 1 point and <blue ribbon>" above)
3. The Ranked Pool (only allow top 10 to be added)
4. The Not Interested Pool
To make room for this suggestion on the Ranking screen the NI pool doesn't really need to be seen along side the other pools because as the contest goes on it's all Withdrawn entries anyway. So the NI column could just be an Icon that expands when clicked in case you wanted to pull a design back out. The top 10 Ranked Pool doesn't need to be as big as the other 2 pools either. It should be a strip of smaller thumbnails so that 10 fit on a typical screen. The New and Unranked Pool and the Show Pool need to be bigger because you're still constantly wanted to see those designs and make decisions. The logos in the Ranked Pool you've looked at many times. Above the Show Pool would be clear instructions. "These Logos receive 1 point and a blue ribbon". In the Ranked column the points awarded should just be shown under the logo so it's very clear that 4-6 receive one point level and 7-10 receive another. As you move a logo into the Ranked Pool, The 10th logo drops out into the Show Pool automatically.
This would save the CHs time also because they don't have to worry about the order of the logos in the Show Pool, just the Top 10.
The problem for us was that we didn't know about the point system and we used the Not Interested column in the beginning when we had decided on a particular concept of a designer and wanted to hide the other concepts. It didn't mean we didn't like the other concepts we just wanted less designs in the New and Unranked Column so we could focus. And we were only adding designs to the Ranked column that were close and wanted to work on variations. So we weren't giving any credit for the designers efforts and this frustrated some designers. The above system would remove any confusion.
The current system is somewhat obscure and one might think that if CHs don't know about the point system you will get better reresentative overall rankings but the problem is, eventually the CH is told by a designer how things work and then they feel obligated to rank at least each concept of everyone who made an effort so they get that one point for entering. Just remove all confusion and make it automatic and clear for everyone.