08/22 - Mental Awareness / Motivation Monday

[THFYM]

Help! I just got 20+ of these emails...?

You about to lose your account, fam.

 

[<Gucci>]

Title: Auditory Experiment - possible BONUS $3.25 for a total of $3.55 in ~35min! | PANDA Requester: McDermott Experiments [A19YWY6E1CP566] (TO) TO Ratings: ★★★★★ 2.73 Communicativity ★★★★★ 3.09 Generosity ★★★★★ 4.11 Fairness ★★★★★ 4.21 Promptness Number of Reviews: 103 | TOS Flags: 0 Submit a new TO review Description: Bonus $3.25 awarded for good performance (see preview for pay scheme)! Make judgments about sounds (e.g., are two sounds the same or different?) Time: 60 minutes HITs Available: 1 Reward: $0.30 Qualifications: Total approved HITs is not less than 50;Location is one of: CA, US;HIT approval rate (%) is not less than 90

 

[Nytmair]

no worries. just cleaning house.

That means that they will post the next batch soon.

Ok glad it's not a big deal.. But I have to retake/re-qual for tons of things now though?

 

[<Gucci>]

Title: Help us Norm Materials For Future Studies | PANDA Requester: Stanford Lab [A2EBHJ9EPPJUVV] (TO) TO Ratings: ★★★★★ 3.40 Communicativity ★★★★★ 3.87 Generosity ★★★★★ 4.33 Fairness ★★★★★ 4.33 Promptness Number of Reviews: 15 | TOS Flags: 0 Submit a new TO review Description: Spend 3-5 minutes helping us norm materials for use in future studies. You may be asked to read short blurbs or look at photographs and rate them on various dimensions. Alternatively, you may be asked to complete short puzzles or word/number games. Time: 12 minutes HITs Available: 1 Reward: $0.20 Qualifications: Total approved HITs is not less than 100;HIT approval rate (%) is not less than 95;Location is US

 

[Im a Zebra]

The $60 hit is fair. Weisian is a good honest and trustworthy requester too. He fixed the problem I was having with my bonus payment in minutes when I messaged him. The bonus makes it come out to 7 dollars an hour. The blocks were not hard. Some of them go as fast as 5 minutes. Turkers work for way crappier wages than 7 dollars an hour when work is scarce. I'll make sure I leave you a good review on your TO W @weisian

Also,

do you have contact info for him ? im having issues with mine right now

 

[Raven]

Ok glad it's not a big deal.. But I have to retake/re-qual for tons of things now though?

no. Those are just retake quals. they are prolly gonna post a batch soon.

 

[Squatty]

Ok glad it's not a big deal.. But I have to retake/re-qual for tons of things now though?

No. They give you a qual for each hit you do, so you can't do the same hit again. Then before the next batch, they revoke all of those.

 

[LowCalCalzone]

Oh good I came back just in time for the old '6-7 dollars an hour is a good wage' conversation

 

[Nytmair]

No. They give you a qual for each hit you do, so you can't do the same hit again. Then before the next batch, they revoke all of those.

Ohhhh I gotcha.
I didn't realize until after I posted that ll these relate to Zazzle. I thought it was all different requestors.

Thanks Squatty- as always

 

[King of Antarctica]

I had a job interview today and it's awkward af trying to explain some aspects of this lol. Hopefully I didn't miss too many good things today.

 

[Wgeo]

Sure, but interpreting reviews is an interesting business. You kinda want to trust reviews to the extent that they reflect the opinion of a person like you. Often we just go by averages, assuming that they are removing minor biases. But if there is a selection bias that can still be unhelpful.

For instance, I always laugh when I see a 1 star shoe review that says something like "these shoes were way too small! 1 star!". I mean, yeah, it's a bit annoying that there isn't perfect size consistency across shoes, but that seems like an odd criteria to use for review.

I would think for a HIT, generosity on TO should reflect whether the pay is better or worse than you would think before starting the HIT. "The pay isn't that much for the time, but don't worry, the HIT doesn't take much time!" would lead to a higher than average rating. Otherwise you are just reflecting each person's particular pay/time bar. You want the review system to reflect the HIT, not the people reviewing it.

I'm getting carried away though (thinking about interpreting reviews is fun!). The takeaway is our HIT is clearly the best ever and you should only listen to reviews that verify that claim

That is very interesting, but I couldn't disagree with you more. The most important part of TO is reflecting on what the pay/hour is. Not whether the hit was fun or quick. I treat turk like a job and want to know what my hourly pay is. If a hit pays less than minimum wage I want to know. Often requesters are very off in their time estimates on the hit, TO provides a place to find out what a more accurate hourly rate you are likely to get on a given hit.

The problem with TO is that it is subjective and not objective. So for me, anything below minimum wage gets a 1/5 for pay, where someone else might give minimum wage a 3/5 or even a 5/5 depending on their own opinions. The averages aren't very helpful, but the workers who report time taken and pay/hour are the most beneficial for me.

 

[ShanaMarie]

Help! I just got 20+ of these emails...?

Ohhhh I gotcha.
I didn't realize until after I posted that ll these relate to Zazzle. I thought it was all different requestors.

Thanks Squatty- as always

You're good.

 

[ccmet121]

Zazzles

 

[Nytmair]

You're good.

Unsure which I would prefer out of those two options.

 

[sryan66611]

You about to lose your account, fam.

nah fam

 

[weisian]

That is very interesting, but I couldn't disagree with you more. The most important part of TO is reflecting on what the pay/hour is. Not whether the hit was fun or quick. I treat turk like a job and want to know what my hourly pay is. If a hit pays less than minimum wage I want to know. Often requesters are very off in their time estimates on the hit, TO provides a place to find out what a more accurate hourly rate you are likely to get on a given hit.

The problem with TO is that it is subjective and not objective. So for me, anything below minimum wage gets a 1/5 for pay, where someone else might give minimum wage a 3/5 or even a 5/5 depending on their own opinions. The averages aren't very helpful, but the workers who report time taken and pay/hour are the most beneficial for me.

That's a great point. I assumed that requesters give good pay/time estimates. If those are off you need an independent validator and it makes sense to trust TO over the requester's reported pay/time estimates.

Edit: I should mention that such a feeling would be reflected in my point about TO generosity reflecting "better or worse than you would expect before completing the HIT". That's one way to remove subjectivity.

Say a requester says pay will be $1/5 minutes. Cool, $12/hour? But you find that it actually takes 8 minutes. That's still above minimum wage, but would you give it a high TO rating?

Rating in this way is kinda trusting the reader to use their own judgment. You're saying to the potential turker "Evaluate this HIT, but then add this extra information - that it's better/worse than you thought".

...I don't think this is practical however. Your system is more practical and works fine if there are many reviews and there is no selection bias. Those things aren't true either though... difficulties...

 

[Not A Robot]

Title: Evaluating an Assault Case(~ 10 minutes) | PANDA Requester: Erika Hall [A3CKDYISR9EZ52] (Contact) (TO): [Pay: 4.54] [Fair: 5.00] [Comm: 5.00] [Fast: 5.00] Description: 10-minute survey Time: 30 minutes(s) HITs Available: 1 Reward: $1.00 Qualifications: Total approved HITs GreaterThanOrEqualTo 100; Exc: [1069608437-19518] DoesNotExist; HIT approval rate (%) GreaterThanOrEqualTo 95; Location In US;

 

[LightningLord]

Is there a script for zazzle that lets you select the choices using the keypad, and enter to move to the next one?

 

[Nytmair]

Is there a script for zazzle that lets you select the choices using the keypad, and enter to move to the next one?

Did Zazzles post or just preparing?

 

[LightningLord]

Did Zazzles post or just preparing?

Posted about 5 min ago. I only caught three though.