Mechanical Turk Lessons Learned

[SJC]

http://engineering.curalate.com/2017/02/01/mechanical-turk-lessons-learned.html

 

[Peachy]

http://engineering.curalate.com/2017/02/01/mechanical-turk-lessons-learned.html

"masters turkers are worth it" - " their answers are more consistent compared to non-masters".

Not disagreeing with the former, but they said in the article that all their hits have been Masters, so how would they know the answers are more consistent compared to non-masters if they've never been non-masters before?

 

[electrolyte]

"masters turkers are worth it" - " their answers are more consistent compared to non-masters".

Not disagreeing with the former, but they said in the article that all their hits have been Masters, so how would they know the answers are more consistent compared to non-masters if they've never been non-masters before?

They're probably going 100% off of what Amazon says, which is that Masters are more consistent than non-Masters.

 

[Peachy]

They're probably going 100% off of what Amazon says, which is that Masters are more consistent than non-Masters.

Then it's not 100% accurate then

Not griping. Just saying. Just thought it was comical that they're saying something without first hand witnessing it for themselves