Grading Student Assignments

[byron_s]

Hello all, I am starting from scratch on an "automated assignment Grading system" and I believe mturk would be a good solution to perform the actual work of grading... But I'm here for your feedback and wisdom.

1. Would mturk workers be consistently able to accurately grade student assignments if they have the original lesson, the assignment instructions, the rubric and/or answer key and the student submission?

2. How likely am I to consistently get quality reasons for point deductions?

3. What should I include in my HIT to ensure quality, consistency and accuracy?

4. Assuming student submissions are complete (all requirements filled) and it takes no more than 5 minutes to check answers, what should be the HIT value for each assignment?

I am looking forward to your replies!

 

[Ajsamue2]

Hi there,

I'm a little late to the party, but I'll try to answer. I work part-time as a biology teacher/studying for the MCAT and I still Turk on the side. I'm sure there are others on this platform like me.

1. Yes, absolutely. I would create a credential that requires some competency so that you don't get people randomly clicking buttons, or to find teachers like me.

2. Very likely. Everyone is scared of decreasing their score. A very limited population Christmas tree the directions for money.

3. Create a hit that pays nothing for qualifications to weed people out. If you want a US-based worker, also put that in your settings. You can then choose workers who put less effort into the Hit than others.

4. I think .25 cents a minute is a fair wage (15/hr) and what most suppliers pay. The requesters that pay less tend to get worse quality.

In addition, I'd be happy to also offer my worker code if you need any adjunct grading help.

Hopefully, this helps!