Oh boy I really wasn't mad about the 16 Monkey Learn rejects till just now...
Hi, Steven.
First of all, I would like to thank you for the time you've taken to write to us asking about the rejection. I just wanted to let you know that we manually revised a random subsample of the batch we sent (20%) and most of the annotations were wrong. Since this was a binary annotation task, we had no alternative but to reject the whole batch. I know this might seem unfair to workers who might have provided good annotations, but, as you will understand, if we have to change most of the annotations of a binary annotation task manually, we'd prefer to annotate the samples ourselves.
If you think there was a problem with the task itself, we would really appreciate it if you could give us feedback on the instructions of the task so as to help us improve our future submissions.
Regards,
Hernán.