06/22 - Techie Thursday!

[Melly]

I know when I go to make a HIT Master's is automatically selected for me. I must deselect the option before I post the HIT. I think some people do not realize that IMO

 

[TSolo315]

Qual test is your best bet but it takes more work.

And the pay has to be sufficient or you're just limiting the amount of desperate people who can work on your HITs.

Going to let the Vacation qual expire again.

Returned it for the second time

 

[Jaded]

Going to let the Vacation qual expire again.

You should pass the first one and then forget about the second one like I did.

 

[themildone]

I have so many stuffed animals in the van @catnapped

you don't even need stuffed animals, just offer him endless amounts of juice. eventually he'll puke it up and immediately want more.

 

[jan]

I think if you're getting the responses you want with masters you could keep it that way. Or use a qual test, or higher approval rate/hits approved qualification.

Qual test is your best bet but it takes more work.

qual test is more economical

 

[Kerek]

Can we just talk about babies now

 

[Kerek]

qual test is more economical

Time is money, friend.

 

[loki3404]

Is it going to be that type of day here?

 

[unfortuNate]

Ok. so what would you say is the best way of ensuring good quality responses? Without the Master qual, we've had some instances where someone just goes through quickly, submitting junk responses. We obviously do our own QA to catch these, but it just wastes time blocking them and re-posting the HITs they did.

Honestly, if you're liking your data so far that you've been getting with the Masters qual, then just keep it that way. But if you're still seeing plenty of issues, I would recommend making a qual test.

 

[sinon]

Title: VacationRentalAPI Qual Test: Find the address for these rental listings | PANDA Worker: Preview | Accept | Requester Requester: VacationrentalAPI [A2QKOWG2NKRJ2K] (Contact) TO 1: [Pay: 2.11] [Fast: 2.50] [Comm: 2.83] [Fair: 4.00] [Reviews: 12] [ToS: 0] TO 2: [Rate: $7.50/hr] [Pen: 7.00 days] [Res: -- of 0] [Rec: 50% of 2] [Rej: 0] [ToS: 0] [Brk: 0] Description: Given a short-term home rental listing, find the address Time: 12 hours HITs Available: 1 Reward: $0.00 Qualifications: Advanced Research Master has not been granted;

HIT exported from Mturk Suite v1.21.10​

In case people haven't seen this yet - vacationrental qual HIT

Oh my god

 

[unfortuNate]

because the requester is clearly soliciting feedback about how to improve their HITs. what's the problem with discussing?

Because it has turned away from providing feedback to non-masters getting pissed off

 

[loki3404]

Title: Earn over $5 in 16 days! Online food takeout and eating habits(~ 5 minutes) | PANDA Worker: Preview | Accept | Requester Requester: Ye Chen [A1TD0DY1HUWTKZ] (Contact) TO 1: [Pay: 5.00] [Fast: 5.00] [Comm: 0.00] [Fair: 5.00] [Reviews: 2] [ToS: 0] TO 2: [Rate: $9.40/hr] [Pen: -- days] [Res: -- of 0] [Rec: -- of 0] [Rej: 0] [ToS: 0] [Brk: 0] Description: We would like to know your eating habits Time: 1 hour 28 minutes HITs Available: 1 Reward: $1.80 Qualifications: Location In US-CT, US-DC, US-DE, US-GA, US-MA, US-MD, US-ME, US-NC, US-NH, US-NJ, US-NY, US-OH, US-PA, US-RI, US-SC, US-VA, US-VT, US-WV; Masters Exists ; Exc: [47607-47018] DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 50; HIT approval rate (%) GreaterThanOrEqualTo 95; TP Panel: 142319344 N GreaterThanOrEqualTo 100;

HIT exported from Mturk Suite v1.21.10​

quick

 

[spantifical]

Can we just talk about babies now

I get to see my grandbaby this weekend. He'll be a day shy of a month old.

 

[kewlncguy]

Ok. so what would you say is the best way of ensuring good quality responses? Without the Master qual, we've had some instances where someone just goes through quickly, submitting junk responses. We obviously do our own QA to catch these, but it just wastes time blocking them and re-posting the HITs they did.

I work hard to maintain a 100% approval rating. Shouldn't that have some weight?

 

[spantifical]

How long has it taken people to hear back about the API qual after submitting it?

 

[bxpretzel]

Because it has turned away from providing feedback to non-masters getting pissed off

i haven't noticed anyone getting pissed off, maybe i'm ignorant *shrug*

 

[jan]

Is it going to be that type of day here?

I'm on my way out. Just have to get up my darling teenager to drag her to the library because she STILL has work left to do

 

[GenericPear]

Hello here

 

[sofaslug]

Open ended questions, 3:30, YMMV

Title: Survey about assessment and experience | PANDA Requester: Research Institute [A3GVLPE7KCTFF4] (TO) TO Ratings: 5.00 Communicativity 3.06 Generosity 5.00 Fairness 5.00 Promptness Number of Reviews: 16 (Submit a new TO rating for this requester) Description: Easy, intuitive, and fast survey Time: 10 minutes Hits Available: 1 Reward: $0.40 Qualifications: Masters has been granted; HIT approval rate (%) is greater than 95; Location is US

 

[deanj]

Hi Dean,

Thanks for posting about your tasks here and looking for feedback. I did see these tasks available the other day but just eyeballing them let me know it would take too long do do each task for me to make it worth it. I just previewed another hit to give you some feedback and it looks like the article is roughly 630 words which takes around 3 minutes for an average person to read (according to some google-fu). On top of that, there is the selection time which may be where you get the 35 second average? However, that would make this HIT pay $.10 for 3.5 minutes of work. That's $1.71 per hour.

As @bxpretzel said, this isn't really worth it to those of us that would put in a full effort on the tasks.

Hi, the 35 seconds is the "Average Time per Assignment" for the batch, which is a figure MT provides, so I was using this to calculate what a reasonable hourly rate would be. Presumably this "selection time" is the time between assignments? How long is that, generally?