POV-Ray : Newsgroups : povray.general : IRTC - Proposal for voting policies Server Time
4 Nov 2024 23:19:16 EST (-0500)
  IRTC - Proposal for voting policies (Message 1 to 10 of 53)  
Goto Latest 10 Messages Next 10 Messages >>>
From: David Buck
Subject: IRTC - Proposal for voting policies
Date: 10 Mar 2008 21:57:36
Message: <47d5f520$1@news.povray.org>
I'd like to thank everyone for their feedback.  It has been very 
valuable and insightful for me to see how you do your voting.  As you 
can expect, it will be impossible to satisfy everyone with any proposal, 
so I'm going to take my best stab at what I feel is a reasonable 
proposal based on the feedback I've been hearing and taking the aspects 
I like the most.

1) Who votes
    - IRTC administrators
    - Anyone who submitted an image to a competition within the last year
    - Anyone who asked and was approved by an IRTC admin
       - I would suggest that this be an exceptional case

2) Registration
    - You don't need to register in order to view all submissions
    - You do need to register in order to submit
    - Registration will capture home address and phone number
       - this helps prevent fraud
       - allows IRTC admins at their discretion to award prizes
       - registration information is only available to IRTC admins

3) Voting
    - Votes would be on a scale of 1 to 10
       - A vote of 0 means the voter didn't rank the image
       - A voter must rank all images (except their own)
       - If they don't rank all images, they can't submit their votes

    - Voters don't see who submitted the image until voting is finished
    - Voters don't see other votes or voter comments until voting is 
finished

    - Every voter must provide a comment on each image they vote on
       - Voting is a privilege and a responsibility
       - Providing constructive comments helps everyone
       - The submitters put a lot of effort into their work, the
          voters should respect that with appropriate comments

    - Each ranking level corresponds to a text description
       - the text description is displayed beside the rank
       - eg.
          [1] = Lacks both knowledge and effort
          [2] = Shows BEGINNER level skills
          [3] = Shows moderate BASIC skills
          [4] = Shows good BASIC skills
          [5] = Shows very good BASIC skills
          [6] = Shows ADVANCED level skills
          [7] = Shows very ADVANCED level skills
          [8] = Shows EXPERT level skills
          [9] = Shows SUPERB skills
          [10] = Shows EXTRAORDINARY skills(WOW!)

    - Ranking will be in 3 categories
       - Technical merit - how well the artist used tools and skills
       - Artistic merit - how artistically appealing the image is
       - Concept and interpretation of theme
          - how well the artist captured the theme of the competition

    - Overall is the total score of Technical + artistic + concept

    - 1st place, 2nd place and 3rd place are submissions with the three 
highest average overall scores.
       - i.e., total of overall scores / votes cast

    - Excluding 1st, 2nd and 3rd place winners, three more awards are
       - technical merit - best average technical merit score
       - artistic merit - best average artistic merit score
          - excluding winners of technical merit
       - concept and interpretation of theme - best average concept score
          - excluding winners of technical or artistic merit

4) IRTC admins have the power to disqualify voters for misconduct
    - Inappropriate comments, vote rigging, etc.
    - Hopefully this power will rarely be needed

5) The voting period is the 2 weeks after the submission deadline.

6) Viewers can submit comments on submitted images
    - comments submitted by viewers can be removed by admins if 
inappropriate


Does this sound reasonable?

David Buck


Post a reply to this message

From: Leroy
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 22:44:50
Message: <47D5FF0C.1090309@joplin.com>
Sounds good to me! Can't wait!

One minor thing I'd change

>    - Each ranking level corresponds to a text description
>       - the text description is displayed beside the rank
>       - eg.
>change    [1] = Lacks both knowledge and effort
   to       [1] = Lacks knowledge or effort

Because smart people do dumb things.


Post a reply to this message

From: Nicolas Alvarez
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 22:47:43
Message: <47d600df$1@news.povray.org>

>    - Registration will capture home address and phone number

Does this mean that, being a minor, I can't participate without first 
getting permission from my parents to give such information?

>          [5] = Shows very good BASIC skills
>          [6] = Shows ADVANCED level skills

Wording makes me feel like something is missing between those two levels.

> 5) The voting period is the 2 weeks after the submission deadline.

This means "voting starts immediately after submission deadline, and 
ends 2 weeks later"? With an automated system, I bet "immediately" will 
not mean some hours :)


Post a reply to this message

From: Charles C
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 23:01:20
Message: <47d60410@news.povray.org>
David Buck wrote:
> 3) Voting
>    - Votes would be on a scale of 1 to 10
>       - A vote of 0 means the voter didn't rank the image
>       - A voter must rank all images (except their own)
>       - If they don't rank all images, they can't submit their votes
A vote of 0 would also be impossible given the next two items.

> 
>    - Voters don't see who submitted the image until voting is finished
I'm just wondering how this would affect reading the making-of 
descriptions...


>    - Voters don't see other votes or voter comments until voting is 
> finished

Makes sense.

>    - Overall is the total score of Technical + artistic + concept
> 
>    - 1st place, 2nd place and 3rd place are submissions with the three 
> highest average overall scores.
>       - i.e., total of overall scores / votes cast

Do you mean an individual entrant's total score divided by the number of 
voters?  While seeing the average would be interesting, dividing by the 
number of voters wouldn't change the results in a system with 
all-or-nothing voting.


> 
> Does this sound reasonable?

Yes, except for a couple questions. :)  Thank you for doing this.
Charles


Post a reply to this message

From: David Buck
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 23:26:07
Message: <47d609df$1@news.povray.org>
Leroy wrote:
> 
> Sounds good to me! Can't wait!
> 
> One minor thing I'd change
> 
>>    - Each ranking level corresponds to a text description
>>       - the text description is displayed beside the rank
>>       - eg.
>> change    [1] = Lacks both knowledge and effort
>   to       [1] = Lacks knowledge or effort
> 
> Because smart people do dumb things.
> 

Fair enough.

David Buck


Post a reply to this message

From: David Buck
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 23:29:27
Message: <47d60aa7$1@news.povray.org>
Nicolas Alvarez wrote:

>>    - Registration will capture home address and phone number
> 
> Does this mean that, being a minor, I can't participate without first 
> getting permission from my parents to give such information?

It would probably be a wise move in any event.  If you were to win and 
the IRTC admins decide to send out prizes (T-shirts, mugs, posters, etc) 
they'd need to know where to send them to.

Do you have a problem telling your parents that you're submitting to a 
raytracing competition? :-)

> 
>>          [5] = Shows very good BASIC skills
>>          [6] = Shows ADVANCED level skills
> 
> Wording makes me feel like something is missing between those two levels.

Yes, the wording can be worked on.

> 
>> 5) The voting period is the 2 weeks after the submission deadline.
> 
> This means "voting starts immediately after submission deadline, and 
> ends 2 weeks later"? With an automated system, I bet "immediately" will 
> not mean some hours :)

My intention is to allow the voting to start immediately after the 
contest deadline.  This can be automated so the transition would occur 
instantly.

David Buck


Post a reply to this message

From: David Buck
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 23:36:16
Message: <47d60c40$1@news.povray.org>
Charles C wrote:
> 
> 
> David Buck wrote:
>> 3) Voting
>>    - Votes would be on a scale of 1 to 10
>>       - A vote of 0 means the voter didn't rank the image
>>       - A voter must rank all images (except their own)
>>       - If they don't rank all images, they can't submit their votes
> A vote of 0 would also be impossible given the next two items.
> 
>>
>>    - Voters don't see who submitted the image until voting is finished
> I'm just wondering how this would affect reading the making-of 
> descriptions...

The making-of descriptions should be worded in such a way as to not give 
away the identity of the artist.  Realistically speaking, though, people 
will often be able to guess the artist based on their previous works.  I 
also see artists submitting works in progress to the POVRay news groups 
for comments.  This may be a problem we can't prevent.

> 
>>    - Voters don't see other votes or voter comments until voting is 
>> finished
> 
> Makes sense.
> 
>>    - Overall is the total score of Technical + artistic + concept
>>
>>    - 1st place, 2nd place and 3rd place are submissions with the three 
>> highest average overall scores.
>>       - i.e., total of overall scores / votes cast
> 
> Do you mean an individual entrant's total score divided by the number of 
> voters?  While seeing the average would be interesting, dividing by the 
> number of voters wouldn't change the results in a system with 
> all-or-nothing voting.

It makes a difference if some voters submitted entries and others 
didn't.  Those who submitted entries can't vote on their own entries. 
This means that it's unfair to just total up the ratings.  It would be 
as if they had ranked themselves as 0 in all categories.

Instead, I will add up all of the ranks for an entry and divide by the 
number of people allowed to vote for that entry (which will be everyone 
but the submitter).

> 
>>
>> Does this sound reasonable?
> 
> Yes, except for a couple questions. :)  Thank you for doing this.
> Charles

My pleasure.  It means I get to play with Seaside, to work again with 
the POVRay community and to encourage people to push the limits of the 
technology. It's all good.

David Buck


Post a reply to this message

From: Nicolas Alvarez
Subject: Re: IRTC - Proposal for voting policies
Date: 10 Mar 2008 23:36:58
Message: <47d60c6a$1@news.povray.org>

> Do you have a problem telling your parents that you're submitting to a 
> raytracing competition? :-)

Nope :) And actually odds are I won't even participate (I *know* I'll 
score 1 in originality and such, or just never make it for the 
deadline). I just wanted to mention it, because it seemed strange 
requiring a home address and phone number for a contest where we aren't 
even sure if there will be prizes...


Post a reply to this message

From: Warp
Subject: Re: IRTC - Proposal for voting policies
Date: 11 Mar 2008 00:37:56
Message: <47d61ab4@news.povray.org>
I think we should consider some extraordinary circumstances and what
to do if they happen (let's hope they don't, but...)

  What will be done if the amount of submissions is ridiculously low?
For example, let's assume that two people submit for a given round.

  What will be done if the amount of votes is too low? Let's assume that
in a round of 20 images only 2 people vote.

  Where will the line be drawn?

-- 
                                                          - Warp


Post a reply to this message

From: Fa3ien
Subject: Re: IRTC - Proposal for voting policies
Date: 11 Mar 2008 00:55:36
Message: <47d61ed8$1@news.povray.org>

>    - Ranking will be in 3 categories

Seen Gille's latest post on the matter ?
Seen the graphs ?

Why keep the voting process 3 times longer than necessary ?

Fabien.


Post a reply to this message

Goto Latest 10 Messages Next 10 Messages >>>

Copyright 2003-2023 Persistence of Vision Raytracer Pty. Ltd.