Rep Present Annotating reasons in German Amazon reviews

[UKP-Lab]

Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.

 

[electrolyte]

Title: Meinungen in Produktbewertungen identifizieren. | PANDA Requester: Maria Sukhareva, TU Darmstadt [A3TC8ETMZEPR0K] (TO) TO Ratings: 1.25 Communicativity 2.90 Generosity 4.50 Fairness 2.00 Promptness Number of Reviews: 16 (Submit a new TO rating for this requester) Description: Identifizieren Sie die allgemeine Meinung einer Produktbewertung. Fließendes Deutsch erforderlich! (Fluent German is required for this task!) Time: 15 minutes Hits Available: 4 Reward: $0.12 Qualifications: HIT approval rate (%) is not less than 95; Location is US

 

[RippedWarrior]

Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.

I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!

 

[electrolyte]

I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!

Hmm, I wonder if that was accidental? @UKP-Lab, if you remove the "Location is US" qualification from your HIT, you will allow workers from any country to access your HIT. Is it mandatory for your project that you only use American workers?

 

[UKP-Lab]

Thanks for the feedback. You both are right, including workers from more countries definitely makes sense for this task. We will rework the qualifications in the next few days to allow more workers to complete this task.

 

[UKP-Lab]

We've now opened up our HITs to workers in German-speaking countries (Germany, Austria, Switzerland, etc.). You can find another batch here: https://www.mturk.com/mturk/preview?groupId=32KI9HN0SIS0WT6BC351OPZJT6YU1W

 

[UKP-Lab]

I find it curious that you've excluded workers from Germany from completing this task.

The problem is that the command-line tools that Amazon provides to requesters do not permit the creation of HITs that are limited to workers in a set of countries—you can either set the HITs to be available to workers in any country, or set a single country. We decided to restrict our HITs by country because some workers were submitting work even though they obviously couldn't speak German. We chose the US because Amazon no longer allows sign-ups from Germany, whereas there are a lot of fluent German speakers living in the US.

We have since worked around Amazon's one-country limitation by using a different tool to configure our HITs.

 

[UKP-Lab]

Another batch of 300 HITs here: https://www.mturk.com/mturk/preview?groupId=3BWB13R124KRHQOBE59GGN4B35KAIV

 

[UKP-Lab]

Dear all,

We've posted another thousand or so HITs here: https://www.mturk.com/mturk/preview?groupId=31RF5NHNFPTXD3JH3PD0X230GG1L1R

As before, fluent German is required for the task.

 

[electrolyte]

Title: Meinungen in Rezensionen identifizieren | PANDA Worker: Preview | Accept | Requester Requester: Tristan Miller, TU Darmstadt [A3TC8ETMZEPR0K] (Contact) TO 1: [Pay: 2.90] [Fast: 2.00] [Comm: 1.25] [Fair: 4.50] [Reviews: 17] [ToS: 0] TO 2: Not Available Auto Approval: 15 days Time: 15 minutes HITs Available: 963 Reward: $0.12 Qualifications: Location is one of: AT, CH, DE, LI, LU, US; HIT approval rate (%) is not less than 95;

 

[UKP-Lab]

More German-language HITs here. These ones pay a bit more (15¢/assignment) than previously (12¢/assignment): https://www.mturk.com/mturk/preview?groupId=3WOK1A2U0JBEFRVPQ8FCEPVV7761DY

 

[electrolyte]

More German-language HITs here. These ones pay a bit more (15¢/assignment) than previously (12¢/assignment): https://www.mturk.com/mturk/preview?groupId=3WOK1A2U0JBEFRVPQ8FCEPVV7761DY

Title: Meinungen in Rezensionen identifizieren | PANDA Worker: Preview | Accept | Requester Requester: Tristan Miller, TU Darmstadt [A3TC8ETMZEPR0K] (Contact) TO 1: [Pay: 3.09] [Fast: 2.00] [Comm: 1.25] [Fair: 4.56] [Reviews: 18] [ToS: 0] TO 2: Not Available Description: Identifizieren Sie Argumente für oder gegen die Meinung des Rezensenten über ein Produkt. Fließendes Deutsch erforderlich! (Fluent German is required for this task!) Time: 15 minutes HITs Available: 953 Reward: $0.15 Qualifications: Location is one of: AT, CH, DE, LI, LU, US; HIT approval rate (%) is not less than 95;