Rep Present Annotating reasons in German Amazon reviews

UKP-Lab · Dec 9, 2016

Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.

electrolyte · Dec 9, 2016

Title: Meinungen in Produktbewertungen identifizieren. | PANDA
Requester: Maria Sukhareva, TU Darmstadt [A3TC8ETMZEPR0K] (TO)
TO Ratings:

1.25 Communicativity
2.90 Generosity
4.50 Fairness
2.00 Promptness
Number of Reviews: 16
(Submit a new TO rating for this requester)
Description: Identifizieren Sie die allgemeine Meinung einer Produktbewertung. Fließendes Deutsch erforderlich! (Fluent German is required for this task!)
Time: 15 minutes
Hits Available: 4
Reward: $0.12
Qualifications: HIT approval rate (%) is not less than 95; Location is US

RippedWarrior · Dec 9, 2016

UKP-Lab said:
Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.

I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!

electrolyte · Dec 9, 2016

RippedWarrior said:
I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!

Hmm, I wonder if that was accidental?

@UKP-Lab, if you remove the "Location is US" qualification from your HIT, you will allow workers from any country to access your HIT. Is it mandatory for your project that you only use American workers?

UKP-Lab · Dec 10, 2016

Thanks for the feedback. You both are right, including workers from more countries definitely makes sense for this task. We will rework the qualifications in the next few days to allow more workers to complete this task.

UKP-Lab · Dec 30, 2016

We've now opened up our HITs to workers in German-speaking countries (Germany, Austria, Switzerland, etc.). You can find another batch here: https://www.mturk.com/mturk/preview?groupId=32KI9HN0SIS0WT6BC351OPZJT6YU1W

UKP-Lab · Dec 30, 2016

RippedWarrior said:
I find it curious that you've excluded workers from Germany from completing this task.

The problem is that the command-line tools that Amazon provides to requesters do not permit the creation of HITs that are limited to workers in a set of countries—you can either set the HITs to be available to workers in any country, or set a single country. We decided to restrict our HITs by country because some workers were submitting work even though they obviously couldn't speak German. We chose the US because Amazon no longer allows sign-ups from Germany, whereas there are a lot of fluent German speakers living in the US.

We have since worked around Amazon's one-country limitation by using a different tool to configure our HITs.

UKP-Lab · Jan 4, 2017

Another batch of 300 HITs here: https://www.mturk.com/mturk/preview?groupId=3BWB13R124KRHQOBE59GGN4B35KAIV

UKP-Lab · Mar 31, 2017

Dear all,

We've posted another thousand or so HITs here: https://www.mturk.com/mturk/preview?groupId=31RF5NHNFPTXD3JH3PD0X230GG1L1R

As before, fluent German is required for the task.

electrolyte · Mar 31, 2017

Title: Meinungen in Rezensionen identifizieren | PANDA
Worker: Preview | Accept | Requester
Requester: Tristan Miller, TU Darmstadt [A3TC8ETMZEPR0K] (Contact)
TO 1: [Pay: 2.90] [Fast: 2.00] [Comm: 1.25] [Fair: 4.50] [Reviews: 17] [ToS: 0]
TO 2: Not Available
Auto Approval: 15 days
Time: 15 minutes
HITs Available: 963
Reward: $0.12
Qualifications: Location is one of: AT, CH, DE, LI, LU, US; HIT approval rate (%) is not less than 95;

UKP-Lab · Apr 12, 2017

More German-language HITs here. These ones pay a bit more (15¢/assignment) than previously (12¢/assignment): https://www.mturk.com/mturk/preview?groupId=3WOK1A2U0JBEFRVPQ8FCEPVV7761DY

electrolyte · Apr 12, 2017

UKP-Lab said:
More German-language HITs here. These ones pay a bit more (15¢/assignment) than previously (12¢/assignment): https://www.mturk.com/mturk/preview?groupId=3WOK1A2U0JBEFRVPQ8FCEPVV7761DY

Title: Meinungen in Rezensionen identifizieren | PANDA
Worker: Preview | Accept | Requester
Requester: Tristan Miller, TU Darmstadt [A3TC8ETMZEPR0K] (Contact)
TO 1: [Pay: 3.09] [Fast: 2.00] [Comm: 1.25] [Fair: 4.56] [Reviews: 18] [ToS: 0]
TO 2: Not Available
Description: Identifizieren Sie Argumente für oder gegen die Meinung des Rezensenten über ein Produkt. Fließendes Deutsch erforderlich! (Fluent German is required for this task!)
Time: 15 minutes
HITs Available: 953
Reward: $0.15
Qualifications: Location is one of: AT, CH, DE, LI, LU, US; HIT approval rate (%) is not less than 95;

Rep Present Annotating reasons in German Amazon reviews

UKP-Lab

New Member

electrolyte

The Ghost of MTurk Past

RippedWarrior

New Member

electrolyte

The Ghost of MTurk Past

UKP-Lab

New Member

UKP-Lab

New Member

UKP-Lab

New Member

UKP-Lab

New Member

UKP-Lab

New Member

electrolyte

The Ghost of MTurk Past

UKP-Lab

New Member

electrolyte

The Ghost of MTurk Past