04/19 - Trap Thursday!

[A6_Foul_Out]

What is a decent qualification value for "acceptance rate". Is 95 too high?

most if not all workers will be 99% so "greater than or equal to 99%" is appropriate.

the best thing is to revoke quals from people who clearly aren't doing your task very well.

 

[mboone73]

What is a decent qualification value for "acceptance rate". Is 95 too high?

I wouldn't think so.

 

[ecko]

What is a decent qualification value for "acceptance rate". Is 95 too high?

I would go with 99.

 

[C to the J]

What is a decent qualification value for "acceptance rate". Is 95 too high?

Like the panda said 99.
Anyone below that either doesn't have enough experience or made too many mistakes.

99.89% over here.

 

[mboone73]

Like the panda said 99.
Anyone below that either doesn't have enough experience or made too many mistakes.

99.89% over here.

Showoff.

 

[C to the J]

Showoff.

Man I was at like 99.95% for a year and a half but a mass rejection (which I take full responsibility for) took me down.

Now I slowly crawl my way back to 99.9%....which will take another 49k HITs approved (barring no more rejections)

 

[kopete]

Like the panda said 99.
Anyone below that either doesn't have enough experience or made too many mistakes.

99.89% over here.

OMG, 99% sounds like a serious number. I did not know. Thanks!

 

[A6_Foul_Out]

OMG, 99% sounds like a serious number. I did not know. Thanks!

I would not work on Mturk with an account under 99%, you (should) work in such a way that you would never risk putting yourself under that percentage.

Amazon will probably ban you if you get below 95. No mturk account with that low approval is worth using anyway.

closely managing the quality of the work you're getting from specific workers and managing their qual appropriately is how you will get the best data

 

[micky]

nvm

 

[Wanderson]

is 97.5% bad?

 

[C to the J]

is 97.5% bad?

If you are still new, no not really but you need to get that number up.

Pay attention to the fairness rating on Turkopticon to avoid reject happy requesters in the future.

 

[Starslip]

33 min according the sources.

part 2 is all writing.

this is why I'm not it.

About 35 for me

 

[SAJ]

Like the panda said 99.
Anyone below that either doesn't have enough experience or made too many mistakes.

99.89% over here.

Spoiler

Log in or register now. to view Spoiler content!

 

[A6_Foul_Out]

is 97.5% bad?

changing 97.5% into 99% with 1k total hits done is way easier than with 100k hits done.

 

[kopete]

I would not work on Mturk with an account under 99%, you (should) work in such a way that you would never risk putting yourself under that percentage.

Amazon will probably ban you if you get below 95. No mturk account with that low approval is worth using anyway.

closely managing the quality of the work you're getting from specific workers and managing their qual appropriately is how you will get the best data

Thank you @A6_Foul_Out

 

[Starslip]

most if not all workers will be 99% so "greater than or equal to 99%" is appropriate.

the best thing is to revoke quals from people who clearly aren't doing your task very well.

Just make sure you don't miss the "or equal to". I don't know if it's still an option after the site change, but sometimes people would set it at greater than 99, which excluded everyone except those who had never gotten a single rejection

So just @YAHU

 

[C to the J]

Spoiler

Log in or register now. to view Spoiler content!

I like to live dangerously.

 

[Wanderson]

If you are still new, no not really but you need to get that number up.

Pay attention to the fairness rating on Turkopticon to avoid reject happy requesters in the future.

I have 1,071 hits approved, less then 2 months working.

 

[Starslip]

but you need to get that number up.

 

[GTR]

All Approved Rate
99.9994%

I've got to do better