Looking for insights from Worker perspective on my HITs as a Requester

[ispajic]

Hi,

I'm new to mTurk and our project is focused on helping indie TV/film producers get insights from audiences. In order to make it cost-efficient for them, we are testing algorithms that look for viewers with high prediction abilities on what the larger population is going to thing. Therefore we have HITs at https://worker.mturk.com/requesters/ASNC1PPLCS4YR/projects?ref=w_pl_prvw but need your feedback on what might need improvements.

Qualifications: certain age groups, UK based, hasn't participated in this HIT before
Duration: according to reports so far, 20-25 minutes
Fees: since I'm running on a limited budget, I'm testing between 2.8-3 $ right now
In case you see multiple HITs on the account, that's because we're trying to decrease the MTurk fees and leave more space for worker fees.

What's your opinion on the HIT?

Thank you,

Ivan

 

[A6_Foul_Out]

these are primarily US based forums, so I'm not too sure how many UK residents are around here to be perfectly honest.

My 10 second reading of the instructions sounded like I could hit the drop-off button to stop the video, does that mean you don't need to finish watching it? I could see how that would be easily exploited.

20 minutes for $3 seems extremely marginal at best, but I wonder if them not getting done is the UK location qualifier.

but if you're not having problems w/data collection it seems like you're fine

 

[ispajic]

Hi, thank you for the input.
Ah, OK, the button doesn't actually stop it, only captures the intent. So that could use rewording then...

What would, in your opinion, be a more fit reward?

UK seems to be second or third biggest on mTurk's list but I do seem to have hard time finding a UK based forum and perhaps the UK mTurkers aren't as frequent as Amazon claims...

 

[A6_Foul_Out]

and perhaps the UK mTurkers

so you're required to complete a qualification test as well, I wonder if removing that will help you get responses.

Non-US turkers are (probably) much less likely to know how to find these types of qualification tests and are less likely to know the HIT exists. Perhaps adding those questions to the hit itself and removing the qualification test would make it easier for those workers to find the HIT.

There's also TurkPrime and Positly, services that help manage academics running HITs and would be able to give a more realistic expectation on the size of the UK workbase on turk

https://www.cloudresearch.com/products/turkprime-mturk-toolkit/
https://www.positly.com/

As for time, I think expanding on it and saying: "you will be required to watch X minutes of video" would give a better understanding of how well the task pays.

If you are hard locked to watching 15 minutes of video at 1x speed, that's different than a 7 minute clip with survey questions after it.

 

[jan]

so you're required to complete a qualification test as well, I wonder if removing that will help you get responses.

Non-US turkers are (probably) much less likely to know how to find these types of qualification tests and are less likely to know the HIT exists. Perhaps adding those questions to the hit itself and removing the qualification test would make it easier for those workers to find the HIT.

There's also TurkPrime and Positly, services that help manage academics running HITs and would be able to give a more realistic expectation on the size of the UK workbase on turk

https://www.cloudresearch.com/products/turkprime-mturk-toolkit/
https://www.positly.com/

As for time, I think expanding on it and saying: "you will be required to watch X minutes of video" would give a better understanding of how well the task pays.

If you are hard locked to watching 15 minutes of video at 1x speed, that's different than a 7 minute clip with survey questions after it.

Can UK turkers cash out -with cash? I thought they were still restricted to gift cards (making it much more difficult)?

 

[Lumius]

There's also many Mturkers who use Prolific as well, which pays in GBP for UK individuals, and is much more popular with the EU crowd.

It may work better for targeting a purely UK crowd.
I @ispajic