---------------------------------
Hi, Mr. Took You Three Times To Pass The Qual Test
Congratulations Idiot, you passed the qualification test. You can know start doing our validation HITs by searching for Cornell LIC.
Here are some commonly asked questions regarding the task:
1. Should I mark the sentence as false if the sentence mentions a specific dog species (such as border terrier) but the images contain another dog species that look somewhat close but not quite right?
Ans: We do not care much about specific animal species. If the difference is big enough (such as toucan vs parrot) for an average kid/AI who is unfamiliar with animals species to tell, then report. Otherwise just ignore the species name.
2. What if the sentences can be interpreted in multiple ways
Ans: We do not have specific guidelines on that. Use your intuition.
3. Should I report sentences that contain minor grammar/spelling mistakes?
Ans: No.
Please also refer to the Q&A Google Doc in the instruction for newest updates.
Best,
Stephanie Zhou
I should read my email more often