 |
|
|
|
|
|
| |
| |
|
|
|
|
| |
| |
|
|
I'd like to thank everyone for their feedback. It has been very
valuable and insightful for me to see how you do your voting. As you
can expect, it will be impossible to satisfy everyone with any proposal,
so I'm going to take my best stab at what I feel is a reasonable
proposal based on the feedback I've been hearing and taking the aspects
I like the most.
1) Who votes
- IRTC administrators
- Anyone who submitted an image to a competition within the last year
- Anyone who asked and was approved by an IRTC admin
- I would suggest that this be an exceptional case
2) Registration
- You don't need to register in order to view all submissions
- You do need to register in order to submit
- Registration will capture home address and phone number
- this helps prevent fraud
- allows IRTC admins at their discretion to award prizes
- registration information is only available to IRTC admins
3) Voting
- Votes would be on a scale of 1 to 10
- A vote of 0 means the voter didn't rank the image
- A voter must rank all images (except their own)
- If they don't rank all images, they can't submit their votes
- Voters don't see who submitted the image until voting is finished
- Voters don't see other votes or voter comments until voting is
finished
- Every voter must provide a comment on each image they vote on
- Voting is a privilege and a responsibility
- Providing constructive comments helps everyone
- The submitters put a lot of effort into their work, the
voters should respect that with appropriate comments
- Each ranking level corresponds to a text description
- the text description is displayed beside the rank
- eg.
[1] = Lacks both knowledge and effort
[2] = Shows BEGINNER level skills
[3] = Shows moderate BASIC skills
[4] = Shows good BASIC skills
[5] = Shows very good BASIC skills
[6] = Shows ADVANCED level skills
[7] = Shows very ADVANCED level skills
[8] = Shows EXPERT level skills
[9] = Shows SUPERB skills
[10] = Shows EXTRAORDINARY skills(WOW!)
- Ranking will be in 3 categories
- Technical merit - how well the artist used tools and skills
- Artistic merit - how artistically appealing the image is
- Concept and interpretation of theme
- how well the artist captured the theme of the competition
- Overall is the total score of Technical + artistic + concept
- 1st place, 2nd place and 3rd place are submissions with the three
highest average overall scores.
- i.e., total of overall scores / votes cast
- Excluding 1st, 2nd and 3rd place winners, three more awards are
- technical merit - best average technical merit score
- artistic merit - best average artistic merit score
- excluding winners of technical merit
- concept and interpretation of theme - best average concept score
- excluding winners of technical or artistic merit
4) IRTC admins have the power to disqualify voters for misconduct
- Inappropriate comments, vote rigging, etc.
- Hopefully this power will rarely be needed
5) The voting period is the 2 weeks after the submission deadline.
6) Viewers can submit comments on submitted images
- comments submitted by viewers can be removed by admins if
inappropriate
Does this sound reasonable?
David Buck
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Sounds good to me! Can't wait!
One minor thing I'd change
> - Each ranking level corresponds to a text description
> - the text description is displayed beside the rank
> - eg.
>change [1] = Lacks both knowledge and effort
to [1] = Lacks knowledge or effort
Because smart people do dumb things.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
> - Registration will capture home address and phone number
Does this mean that, being a minor, I can't participate without first
getting permission from my parents to give such information?
> [5] = Shows very good BASIC skills
> [6] = Shows ADVANCED level skills
Wording makes me feel like something is missing between those two levels.
> 5) The voting period is the 2 weeks after the submission deadline.
This means "voting starts immediately after submission deadline, and
ends 2 weeks later"? With an automated system, I bet "immediately" will
not mean some hours :)
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
David Buck wrote:
> 3) Voting
> - Votes would be on a scale of 1 to 10
> - A vote of 0 means the voter didn't rank the image
> - A voter must rank all images (except their own)
> - If they don't rank all images, they can't submit their votes
A vote of 0 would also be impossible given the next two items.
>
> - Voters don't see who submitted the image until voting is finished
I'm just wondering how this would affect reading the making-of
descriptions...
> - Voters don't see other votes or voter comments until voting is
> finished
Makes sense.
> - Overall is the total score of Technical + artistic + concept
>
> - 1st place, 2nd place and 3rd place are submissions with the three
> highest average overall scores.
> - i.e., total of overall scores / votes cast
Do you mean an individual entrant's total score divided by the number of
voters? While seeing the average would be interesting, dividing by the
number of voters wouldn't change the results in a system with
all-or-nothing voting.
>
> Does this sound reasonable?
Yes, except for a couple questions. :) Thank you for doing this.
Charles
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Leroy wrote:
>
> Sounds good to me! Can't wait!
>
> One minor thing I'd change
>
>> - Each ranking level corresponds to a text description
>> - the text description is displayed beside the rank
>> - eg.
>> change [1] = Lacks both knowledge and effort
> to [1] = Lacks knowledge or effort
>
> Because smart people do dumb things.
>
Fair enough.
David Buck
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Nicolas Alvarez wrote:
>> - Registration will capture home address and phone number
>
> Does this mean that, being a minor, I can't participate without first
> getting permission from my parents to give such information?
It would probably be a wise move in any event. If you were to win and
the IRTC admins decide to send out prizes (T-shirts, mugs, posters, etc)
they'd need to know where to send them to.
Do you have a problem telling your parents that you're submitting to a
raytracing competition? :-)
>
>> [5] = Shows very good BASIC skills
>> [6] = Shows ADVANCED level skills
>
> Wording makes me feel like something is missing between those two levels.
Yes, the wording can be worked on.
>
>> 5) The voting period is the 2 weeks after the submission deadline.
>
> This means "voting starts immediately after submission deadline, and
> ends 2 weeks later"? With an automated system, I bet "immediately" will
> not mean some hours :)
My intention is to allow the voting to start immediately after the
contest deadline. This can be automated so the transition would occur
instantly.
David Buck
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Charles C wrote:
>
>
> David Buck wrote:
>> 3) Voting
>> - Votes would be on a scale of 1 to 10
>> - A vote of 0 means the voter didn't rank the image
>> - A voter must rank all images (except their own)
>> - If they don't rank all images, they can't submit their votes
> A vote of 0 would also be impossible given the next two items.
>
>>
>> - Voters don't see who submitted the image until voting is finished
> I'm just wondering how this would affect reading the making-of
> descriptions...
The making-of descriptions should be worded in such a way as to not give
away the identity of the artist. Realistically speaking, though, people
will often be able to guess the artist based on their previous works. I
also see artists submitting works in progress to the POVRay news groups
for comments. This may be a problem we can't prevent.
>
>> - Voters don't see other votes or voter comments until voting is
>> finished
>
> Makes sense.
>
>> - Overall is the total score of Technical + artistic + concept
>>
>> - 1st place, 2nd place and 3rd place are submissions with the three
>> highest average overall scores.
>> - i.e., total of overall scores / votes cast
>
> Do you mean an individual entrant's total score divided by the number of
> voters? While seeing the average would be interesting, dividing by the
> number of voters wouldn't change the results in a system with
> all-or-nothing voting.
It makes a difference if some voters submitted entries and others
didn't. Those who submitted entries can't vote on their own entries.
This means that it's unfair to just total up the ratings. It would be
as if they had ranked themselves as 0 in all categories.
Instead, I will add up all of the ranks for an entry and divide by the
number of people allowed to vote for that entry (which will be everyone
but the submitter).
>
>>
>> Does this sound reasonable?
>
> Yes, except for a couple questions. :) Thank you for doing this.
> Charles
My pleasure. It means I get to play with Seaside, to work again with
the POVRay community and to encourage people to push the limits of the
technology. It's all good.
David Buck
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
> Do you have a problem telling your parents that you're submitting to a
> raytracing competition? :-)
Nope :) And actually odds are I won't even participate (I *know* I'll
score 1 in originality and such, or just never make it for the
deadline). I just wanted to mention it, because it seemed strange
requiring a home address and phone number for a contest where we aren't
even sure if there will be prizes...
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
I think we should consider some extraordinary circumstances and what
to do if they happen (let's hope they don't, but...)
What will be done if the amount of submissions is ridiculously low?
For example, let's assume that two people submit for a given round.
What will be done if the amount of votes is too low? Let's assume that
in a round of 20 images only 2 people vote.
Where will the line be drawn?
--
- Warp
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
> - Ranking will be in 3 categories
Seen Gille's latest post on the matter ?
Seen the graphs ?
Why keep the voting process 3 times longer than necessary ?
Fabien.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
