05/06 - Secondhand Saturday!

[Lila. B.]

Customer Question 5:
Again? Thanks, Obama.

SocialTech Security Answer 5:
Your welcome, please follow the link to complete your password reset

 

[aturkerhiding]

I was under the impression this is always how it was, which is why I chose to make separate q/a's and not run along dialogue. He should update the reviews with this also.

Updated review instructions incoming.

 

[aturkerhiding]

"Valid responses are absolutely critical. If workers consistently provide work that doesn't meet the criteria, they will be blocked from working on the bot training hits. I'm not blocking people by reporting them to Amazon as bad workers, but they will be blocked from accessing the hits. In the past I've also been willing to overturn rejections workers received and given them the opportunity to revise their work. Please make sure the workers are following the criteria."

How'd I do?

 

[electrolyte]

Updated review instructions incoming.

Again? They updated the reviews a few minutes ago and the writing ones earlier.

 

[electrolyte]

"Valid responses are absolutely critical. If workers consistently provide work that doesn't meet the criteria, they will be blocked from working on the bot training hits. I'm not blocking people by reporting them to Amazon as bad workers, but they will be blocked from accessing the hits. In the past I've also been willing to overturn rejections workers received and given them the opportunity to revise their work. Please make sure the workers are following the criteria."

So he's going to block them but not tell Amazon...? He'll have to start qual'ing these if he's going to do that correctly without actually using blocks.

 

[aturkerhiding]

Again? They updated the reviews a few minutes ago and the writing ones earlier.

No. I didn't realize he updated them on the fly already.

 

[Drwho10]

Again? They updated the reviews a few minutes ago and the writing ones earlier.

They'll start handing out pdf manuals soon

 

[Deleted member 481]

So he's going to block them but not tell Amazon...? He'll have to start qual'ing these or something if he's going to do that correctly without actually using blocks.

Yeah, I didn't understand that part either. I thought Amazon automatically would know if someone got a block.

 

[aturkerhiding]

So he's going to block them but not tell Amazon...? He'll have to start qual'ing these if he's going to do that correctly without actually using blocks.

I had talked to him about setting a qual. I don't think he'll actually do it. But it gets the point across well I think.

 

[basketcasey]

Is it normal to update the instructions this much?

 

[Drwho10]

Yeah, I didn't understand that part either. I thought Amazon automatically would know if someone got a block.

Yeah they do. He'd have to qual them then disqual people

 

[nopoopwarez]

So he's going to block them but not tell Amazon...? He'll have to start qual'ing these if he's going to do that correctly without actually using blocks.

Maybe assign disqualification quals the way C-sat does?

 

[lobo925]

I had talked to him about setting a qual. I don't think he'll actually do it. But it gets the point across well I think.

Could be a little more clear though

 

[WalkingEmphasis]

Is it normal to update the instructions this much?

Well... usually they'd have clearer instructions to begin with.

 

[aturkerhiding]

Yeah, I didn't understand that part either. I thought Amazon automatically would know if someone got a block.

More like a qual block. You know how some requesters like Ben (the guy with the dating site photos) leave a message that yo uaren't allowed to work on those hits any more

 

[electrolyte]

Yeah, I didn't understand that part either. I thought Amazon automatically would know if someone got a block.

They would.

I had talked to him about setting a qual. I don't think he'll actually do it. But it gets the point across well I think.

So it's not true? That's... I'd rather requesters just be honest about their intentions.

 

[Drwho10]

I had talked to him about setting a qual. I don't think he'll actually do it. But it gets the point across well I think.

But its technically not correct. He should seriously look into how mturk works before setting arbitrary instructions

 

[Pleco]

They'll start handing out pdf manuals soon

Here's the new instructions, please review them thoroughly.

 

[electrolyte]

More like a qual block. You know how some requesters like Ben (the guy with the dating site photos) leave a message that yo uaren't allowed to work on those hits any more

Yeah, but to do that, the HITs have to have a qual on them to begin with and all the workers would have to have a value assigned.

 

[aturkerhiding]

They would.



So it's not true? That's... I'd rather requesters just be honest about their intentions.

What should it be changed to