07/25 - Timpani Thursday!

Best Quentin Tarantino film?


  • Total voters
    69
Status
Not open for further replies.

Random Jobber

Well-Known Member
Joined
Feb 3, 2019
Messages
1,028
Reaction score
1,313
Points
413
Gender
Male
Is anyone working on the zhlei batch for the tweets? I got the qual yesterday but I don't know how safe doing a large amount of these are.
Here's an email they sent out about approvals/etc

We received some new qualified workers’ emails asking about the criteria we will be using to do the quality control for the results of completed tweets. We are writing to address this question.

To ensure the quality, we check the results before we approve the completed tweets. We do this at a regular base, approving the completed HITs every day. For example, we have approved the HITs that you’ve done so far for the task, “ identify Positive/Negative Emotion in tweets - Part 2” since yesterday. You should have received the rewards for these HITs!

We randomly chose the completed HITs and check the results. This is primarily to ensure that new workers understand the task correctly. What is the criteria to decide the quality?

For some HITs, there may not be a definitely “correct” answer for Q1 (the most positive tweet) and Q3 (the most negative tweets). We understand that the emotion information in tweets can be suggestive; or, several tweets may be at similar levels of positiveness (negativeness). These are not the cases we will focus on.

Instead, there are HITs that the answers are obvious, and the errors will be obvious as well. For example, it would be an error if a worker chooses an obvious negative tweet in Q1 while there is another tweet that is clearly positive among the four.

When we identify such obvious errors, we would not just disapprove the HIT. We would notify the worker and communicate with the worker first before we may reject or approve a HIT.
 

Robedom

Active Member
Joined
Jan 31, 2019
Messages
566
Reaction score
1,428
Points
343
Age
32
Gender
Male
Here's an email they sent out about approvals/etc

We received some new qualified workers’ emails asking about the criteria we will be using to do the quality control for the results of completed tweets. We are writing to address this question.

To ensure the quality, we check the results before we approve the completed tweets. We do this at a regular base, approving the completed HITs every day. For example, we have approved the HITs that you’ve done so far for the task, “ identify Positive/Negative Emotion in tweets - Part 2” since yesterday. You should have received the rewards for these HITs!

We randomly chose the completed HITs and check the results. This is primarily to ensure that new workers understand the task correctly. What is the criteria to decide the quality?

For some HITs, there may not be a definitely “correct” answer for Q1 (the most positive tweet) and Q3 (the most negative tweets). We understand that the emotion information in tweets can be suggestive; or, several tweets may be at similar levels of positiveness (negativeness). These are not the cases we will focus on.

Instead, there are HITs that the answers are obvious, and the errors will be obvious as well. For example, it would be an error if a worker chooses an obvious negative tweet in Q1 while there is another tweet that is clearly positive among the four.

When we identify such obvious errors, we would not just disapprove the HIT. We would notify the worker and communicate with the worker first before we may reject or approve a HIT.
Perfect! Thank you for this, eases my mind.
 

scrmcasey

Skynet Aide
Moderator
Gamemaster
Sole Survivor
Joined
Oct 14, 2016
Messages
6,281
Reaction score
17,960
Points
2,213
Location
PA
Gender
Female
Title: Simple Number Games | PANDA
Requester: Prather Lab [AESUWQGRFROXV]
TurkerView: [ $17.77 / hour ]
Description: About 25 mins of simple questions about math
Duration: 60 Min
Available: 1
Reward: $3.00
Qualifications:
  • HIT approval rate (%) GreaterThan 90
  • Location In CA, US
  • Total approved HITs GreaterThan 50
[3YSALWD2ZHSD7UFAJFRS0CXUV2IPHK]
 

lil queen trashmouth

Pile of ham
Contributor
Joined
Jul 6, 2016
Messages
5,115
Reaction score
17,359
Points
1,013
Age
36
Location
Iowa
Gender
Female
In keeping with the poll

Title: Foot Data Collection | Accept
Requester: Alex Chung [A1M2G2ITGO9ZFN] Contact
TV: [Hrly=$82.89] [Pay=Generous] [Approval=1-3 days] [Comm=Unrated] [Rej=0] [Blk=0]
Reward: 15.00
Duration: 1:00:00
Available: 1
Description: The goal of this HIT is to collect data of feet at various angles, attire (barefoot, sock, shoe) and distances.
Qualifications: Total approved HITs GreaterThan 100; Location In US-AL, US-AR, US-DE, US-FL, US-GA, US-IA, US-KS, US-KY, US-LA, US-MD, US-MN, US-MO, US-MS, US-ND, US-NE, US-OK, US-SC, US-SD, US-TN, US-TX, US-VA, US-WV
 
  • Like
Reactions: savvy

Kennedy

Well-Known Member
Contributor
Joined
Jun 18, 2018
Messages
5,702
Reaction score
19,163
Points
1,013
Age
47
Gender
Female
In keeping with the poll

Title: Foot Data Collection | Accept
Requester: Alex Chung [A1M2G2ITGO9ZFN] Contact
TV: [Hrly=$82.89] [Pay=Generous] [Approval=1-3 days] [Comm=Unrated] [Rej=0] [Blk=0]
Reward: 15.00
Duration: 1:00:00
Available: 1
Description: The goal of this HIT is to collect data of feet at various angles, attire (barefoot, sock, shoe) and distances.
Qualifications: Total approved HITs GreaterThan 100; Location In US-AL, US-AR, US-DE, US-FL, US-GA, US-IA, US-KS, US-KY, US-LA, US-MD, US-MN, US-MO, US-MS, US-ND, US-NE, US-OK, US-SC, US-SD, US-TN, US-TX, US-VA, US-WV
No one seems to want Indiana feet! I could make big bucks!
 

Robedom

Active Member
Joined
Jan 31, 2019
Messages
566
Reaction score
1,428
Points
343
Age
32
Gender
Male
In keeping with the poll

Title: Foot Data Collection | Accept
Requester: Alex Chung [A1M2G2ITGO9ZFN] Contact
TV: [Hrly=$82.89] [Pay=Generous] [Approval=1-3 days] [Comm=Unrated] [Rej=0] [Blk=0]
Reward: 15.00
Duration: 1:00:00
Available: 1
Description: The goal of this HIT is to collect data of feet at various angles, attire (barefoot, sock, shoe) and distances.
Qualifications: Total approved HITs GreaterThan 100; Location In US-AL, US-AR, US-DE, US-FL, US-GA, US-IA, US-KS, US-KY, US-LA, US-MD, US-MN, US-MO, US-MS, US-ND, US-NE, US-OK, US-SC, US-SD, US-TN, US-TX, US-VA, US-WV
*looks at feet*

Here we go again.
 

C to the J

Outlaw Turker
Contributor
Master Pleaser
Crowd Pleaser
HIT Poster
Joined
Jan 12, 2016
Messages
53,198
Reaction score
163,916
Points
3,238
Age
37
Gender
Male
Non-fetish is much more prestigious.
 
  • Like
Reactions: savvy
Status
Not open for further replies.