When you take part in the Challenge, you don’t just compete – you also play an important role in the judging process.
Once you’ve registered and submitted your application, making sure it’s complete and valid, you’ll be requested to participate in the to Peer-to-Peer Review process. In order to qualify for the Challenge, you must score at least five (5) other submissions by July 10, 2020, at 11:59 PM PDT.
After that, you may also be asked to review and score additional videos as well.
The Peer-to-Peer Review is great fun, you may learn about some new aspects of science or math – and you get to check out the competition!
For further guidance on how to complete your Peer-to-Peer reviews, see our video tutorial.
If you have any questions about the Peer-to-Peer Review, you may find your answer below:
What is the Peer-to-Peer Review?
As part of your Application to the Challenge, you will be required to take part in the Peer-to-Peer Review. The Peer-to-Peer Review is the first phase of judging the applications to the Challenge, in which the participants review and judge each other’s applications, using specialized judging criteria described below. The same criteria will be used for all judging phases of the Challenge.
Applications will be scored using the Trait Scoring Rubric, which outlines the four criteria you should consider as you review: illumination, engagement, difficulty and creativity. Each of the four criteria will be graded on a 5-point scale. All scores will then be calculated using a special mathematical formula that ensures a fair and level playing field for all entrants.
During the Peer-to-Peer Review, each application will be reviewed by five (5) other participants. Participants will review and score the video based on the four criteria. It’s important that each participant reviews the applications carefully and fairly.
To complete your application and qualify for the prize, you will need to review and score at least five other applications by July 10, 2020 at 11:59 PM PDT (California time). You may be asked to review and score additional applications as well. You may review up to twenty (20) videos a day with a maximum number of 100 reviews.
Will I be notified when I have to start the Peer-to-Peer Review?
Yes. An email from us will alert you to begin your peer evaluations, and provide more instructions.
What’s the relative weight of the Peer-to-Peer review?
For the first round of judging it is 100 percent (100%).
What is the relative weight of each score?
It will depend on the total number of registered users participating in the review and the total number of applications they will review.
Is there a system in place to protect against contestants who “game the system?”
Yes. The Challenge uses a password-protected secure website. The Peer-to-Peer Review is available only for registered users who have completed the entire application process successfully. Peer-to-Peer Reviews are distributed randomly and all the results go through a mathematical normalization process to make sure that it is not possible to “game the system.”
You can find FAQs on other aspects of the Challenge here.
If you have further questions you can contact us at firstname.lastname@example.org.