03/21 - Theory Tuesday!

Kerek · Mar 21, 2017

Bode Miller said:
I thought that was the motto for mturk forums

http://www.mturkcrowd.com/posts/711056/

Deleted member 526 · Mar 21, 2017

humbleturker said:
Title: Evaluate responses from an intelligent assistant | PANDA
Requester: DeepDialogue Eval [A1OJP0JSO1RMWR] (TO)
TO Ratings:

1.00 Communicativity
3.00 Generosity
5.00 Fairness
5.00 Promptness
Number of Reviews: 7
(Submit a new TO rating for this requester)
Description: -
Time: 20 minutes
Hits Available: 16
Reward: $0.50
Qualifications: Total approved HITs is not less than 1; HIT approval rate (%) is not less than 90; Location is US

0 dialogues

nopoopwarez · Mar 21, 2017

humbleturker said:
Title: Evaluate responses from an intelligent assistant | PANDA
Requester: DeepDialogue Eval [A1OJP0JSO1RMWR] (TO)
TO Ratings:

1.00 Communicativity
3.00 Generosity
5.00 Fairness
5.00 Promptness
Number of Reviews: 7
(Submit a new TO rating for this requester)
Description: -
Time: 20 minutes
Hits Available: 16
Reward: $0.50
Qualifications: Total approved HITs is not less than 1; HIT approval rate (%) is not less than 90; Location is US

So when evaluating naturalness, we ignore grammar?

humbleturker · Mar 21, 2017

turker said:
0 dialogues

Put them on PC. Catching 1-2 a minute

humbleturker · Mar 21, 2017

nopoopwarez said:
So when evaluating naturalness, we ignore grammar?

I think grammar can be considered, but I think it's more of how well it flows.

Kallee · Mar 21, 2017

SweetiePuff said:
Title: Experience's Watching AMC's The Walking Dead(~ 30 minutes) | PANDA
Worker: Preview | Accept | Requester
Requester: Social Processes Lab [AEI6Y2RU6JAF] (Contact)
TO: [Pay: 4.00] [Fair: 5.00] [Comm: 4.00] [Fast: 4.86] [Reviews: 7] [ToS: 0]
Description: Survey Topic: The purpose of this study is to examine interpersonal perceptions and people's experiences watching AMC's The Walking Dead.
Time: 1 hour 30 minutes
HITs Available: 17
Reward: $3.00
Qualifications: Total approved HITs GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 95; Exc: [37949-37360] DoesNotExist ; Location In US;

HIT exported from Mturk Suite v1.18.2

~25 mins-ish (I wandered off for a few). The inquisit part was pretty fast - like 5 mins. It was approved almost immediately.

charlie · Mar 21, 2017

Title: Product Evaluations | PANDA
Requester: Tatiana Sokolova [A204B3QO6FE9BF] (TO)
TO Ratings:
★★★★★ 1.89 Communicativity
★★★★★ 3.86 Generosity
★★★★★ 3.76 Fairness
★★★★★ 3.88 Promptness
Number of Reviews: 69 | TOS Flags: 0
Submit a new TO review
Description: Complete a 2-minute consumer judgment survey and earn $0.40
Time: 60 minutes
HITs Available: 1
Reward: $0.40
Qualifications: HIT approval rate (%) is greater than 98;Total approved HITs is greater than 5000;Location is US

2 minutes

ccmet121 · Mar 21, 2017

Kallee said:
~25 mins-ish (I wandered off for a few). The inquisit part was pretty fast - like 5 mins. It was approved almost immediately.

People still watch that show?

Kallee · Mar 21, 2017

ccmet121 said:
People still watch that show?

SweetiePuff · Mar 21, 2017

Bode Miller said:
surprise Inquisit in the middle of the survey if you want to return it before you even start it, instead of returning it after doing the first task like me

Was the simplest, quickest Inquisit ever though ... less than 5m.

Maria Tortilla · Mar 21, 2017

Isn't spider month supposed to be June?

Log in or register now. to view Spoiler content!

Yatagarasu · Mar 21, 2017

Title: Interviewing people with migraine headaches | PANDA
Worker: Preview | Accept | Requester
Requester: John Gribbin [A2MFTIMKZUL86H] (Contact)
TO: [Pay: 5.00] [Fair: 5.00] [Comm: 5.00] [Fast: 5.00] [Reviews: 1] [ToS: 0]
Description: 5-10 minute phone interview. Only for adults, and only for people who get 4+ migraines per month.
Time: 15 minutes
HITs Available: 1
Reward: $1.50
Qualifications: Location EqualTo US;