This Rich guy has actually been incredible receptive to me. Here's some more from him.
Hi Rich,
Will you be doing a qualification hit or will you just be reviewing working that others have done and qualifying them based on performance from the original batch?
Thanks,
Sean
____________________________________
Hi Sean;
In the short term we're going to score and qualify workers based on
the results we have so far. Moving forward we'll be doing some
experimentation to figure out the best way to qualify workers --
either two tiers of HITs, or a qualifying task, or just granting a
'baseline' qualification on request on a one-time basis which we can
update as work is completed. If you've got any suggestions on that
front I'd love to hear them if you're willing (we've got a small bonus
pool approved for that, if that's any incentive).
Thanks again,
Rich