12/09 - Silly Sunday!

[Jerami]

90 mins o.0

Oh fuck. I assumed it was a LOT higher and that was an expire. But, chances are you've got one of the few that has been in a couple of queues already. Well, good luck! Let me know if you DQ though.

 

[catscratch]

Is it a bad idea to do hits for someone who has no reviews?

 

[cb456]

Is it a bad idea to do hits for someone who has no reviews?

it should be fine. its obviously a little more risky than someone with reviews, but if the task seems straight forward, have at it.

 

[Jerami]

Is it a bad idea to do hits for someone who has no reviews?

Nope. Everyone had no reviews at some point and some of the best HITs don't get reviewed for a long timer or ever...More to come but, want to get a quick answer. Basically, do at your own tisk. MOre info to follow.

 

[JenniLeigh]

Oh fuck. I assumed it was a LOT higher and that was an expire. But, chances are you've got one of the few that has been in a couple of queues already. Well, good luck! Let me know if you DQ though.

I didn't DQ.
Good luck to you and your pandas.

 

[turkinlight]

Is it a bad idea to do hits for someone who has no reviews?

If it's a batch, just be careful how many you do. There is a small chance they could all be rejected, but it is very very unlikely. Try to keep in mind how many hits it would take to fall below 99%. As you go further in turking, you'll be able to take more and more risks with unknown requesters.

If it's a survey, definitely go for it. If it's a batch, I like to do a few, check my dashboard, do a few more, and sometimes I'll send the requester a quick email asking them to check to make sure I'm doing them right. A lot of times I'll get a quick reply, and that makes it much easier to keep going.

 

[Herping&Turking]

@turkinlight

I just caught and did that $7.00 tedlab hit that you posted earlier today. Thanks for putting it on here!

 

[turkinlight]

@turkinlight

I just caught and did that $7.00 tedlab hit that you posted earlier today. Thanks for putting it on here!

It was more entertaining than the hits we usually do wasn't it. I just imagined I was talking to a small kid and that made it fun...you know as much "fun" as turking can be.

 

[catscratch]

Nope. Everyone had no reviews at some point and some of the best HITs don't get reviewed for a long timer or ever...More to come but, want to get a quick answer. Basically, do at your own tisk. MOre info to follow.

it should be fine. its obviously a little more risky than someone with reviews, but if the task seems straight forward, have at it.

If it's a batch, just be careful how many you do. There is a small chance they could all be rejected, but it is very very unlikely. Try to keep in mind how many hits it would take to fall below 99%. As you go further in turking, you'll be able to take more and more risks with unknown requesters.

If it's a survey, definitely go for it. If it's a batch, I like to do a few, check my dashboard, do a few more, and sometimes I'll send the requester a quick email asking them to check to make sure I'm doing them right. A lot of times I'll get a quick reply, and that makes it much easier to keep going.

Thanks, I'm already under 99% from just 3 rejections so now I'm more cautious lol

 

[Herping&Turking]

It was more entertaining than the hits we usually do wasn't it. I just imagined I was talking to a small kid and that made it fun...you know as much "fun" as turking can be.

It really was, haha. I imagine my neighbors thought I was nuts though!

 

[turkinlight]

Thanks, I'm already under 99% from just 3 rejections so now I'm more cautious lol

Who were your rejections from. There's always a possibility of getting them overturned.

 

[turkinlight]

Title: News Experiment | PANDA Requester: MSRNE researchers [A1F9W6UY3YL34J] (Req TV): $28.91/hr (TO): [Pay: 4.35] [Fair: 4.86] [Comm: 4.67] [Fast: 4.89] Description: A simple experiment about reading and decision making Time: 1 hour(s) HITs Available: 1 Reward: $0.50 Qualifications: msrne_memory1_done DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 1000; HIT approval rate (%) GreaterThanOrEqualTo 99; Location EqualTo US;

I caught this, but the TV is pretty bad for the hit, on the other hand, there is a possibility of a pretty decent bonus, so probably worth a panda.

Edit: 13 minutes, for a total of around 3.00...not what I expected out of this requester, but better than most.

 

[Merovign]

Thanks, I'm already under 99% from just 3 rejections so now I'm more cautious lol

Always send a message about rejections. My percentage at getting rejections overturned is 100%.

That's one rejection LOL.

 

[Merovign]

Also Imma take the day off, I hope y'all get something cool today like that NLP thing yesterday.

But not *the* NLP thing, 'cause if I miss that again Imma go nuts.

 

[catscratch]

Who were your rejections from. There's always a possibility of getting them overturned.

From two separate people. I had 3 from one person and one from another person. I emailed both of them and I got a response from one of them today.

I told the person who gave me 3 rejections that I'm new and willing to redo them and they said it's "impossible"(?) to redo them but they will overturn the one I messaged about since I'm new. I emailed them back saying thanks. I wish they'd overturn the remaining 2 but I didn't know if that would be asking too much? I still have more pending from that person though. If they reject any more I'll email them again.

 

[catscratch]

Always send a message about rejections. My percentage at getting rejections overturned is 100%.

That's one rejection LOL.

Will do :tearsofjoy:

 

[Jerami]

Is it a bad idea to do hits for someone who has no reviews?

(continuation) ... So, yeah. Some HITs never get reviewed because, why would you tell a million people how awesome your favourite batch is? I mean, being nice is good and all but, that's the sort of mentality that lots of people have and I don't disagree with it. Regardless of what my specific thoughts are I understand. No point in telling your competition how to make your money, other than for karma. Lots of people care more about paying bills that collecting karma points.

Next point, just like reviews on Amazon, not all reviews are created equally, so to speak. Some people are bad at HITs. So, they review people from the perspective of being rejected for what they thought was good work, regardless of how little they followed the instructions. If that's the only review, the requester's score is tanked. But, unfortunately, that doesn't reflect the requester, just the reviewer.

And... TO(turkopticon) is going 'ReadOnly' soon, if not already. So, if that's where you get your reviews, no new ones will be coming.

To touch on the point of no reviews, they're almost always new requesters. As with anything, some new things are good, some are bad, some start off bad and turn good and sometimes the revers happens. Some requesters, when new, are just as new to Mturk as you are. So, they can sometimes have novice problems. That said, some requesters will work through those problems, usually with the help of turkers like you or me. For batches, you'll do a few, message the requester,"Hello. I am completing, and enjoying, your HITs from the batch that posted earlier but, I have a few(questions, suggestions, clarifications, etc). I have been coming across a lot of xxxx that could be marked either xxx or, xxx. What is the best choice in this situation? I only ask to help me to provide you with the best possible data. Thanks in advance for a quick reply. TurkerAYOU86987987"
If they get back to you with a good answer, probably a good requester. And now they know that you care about completing quality work. If they go to Qualified batches, you're in good shape.
If it's not a batch, then helping them by messaging about any errors or broken studies has gotten me a bonus more than once. Some people would review it as "Broken. Do not attempt!" Then they have a bad score, broken HIT and no idea what they are doing. I do some of those too. I like being able to prove that a study isn't broken, just not done correctly. I also like to find the broken ones and help the requesters occasionally.

If a study(HIT) from a requester has no reviews but is being posted by a school(university, college, school "lab, etc.) are pretty safe. You can take that into consideration when deciding to do a non-reviewed HIT. Same with HITs from giant companies.(Amazon, Google[Endor], Snapchat, etc)

Basically, to sum up and answer your question: take all reviews, or lack of reviews with a grain of salt. There are other things that should get equal consideration for you like pay, timer, type of work and if it is something that you can be okay with doing for the pay that is offered. Because, no matter what any of the reviews say, or don't say, only you know what you like and no amount of reviews can convince you that a HIT is worth doing if you don't feel the same about that type of, or that specific HIT. If you don't like transcription, doesn't matter what the reviews are. They'll still suck, to you. Something as small as a "Recall a time when..." writing prompt can change someone's review significantly. It only takes one extra page to turn a review from, "Great HIT!" to ,"Bubble HELL!"

So, use your best judgement and don't let a review sway your decision too much in either direction(barring extreme cases). And with no reviews, still rely on the information that you have(pay, description, timer) to decide for yourself if it looks like it's worth doing. Most of the time you'll be fine and, sometimes when you should be fine, you still get a random rejection or a horrible requester. Just never get too deep(too many pending HITs) with one requester, until you feel safe with that requester.

Good luck.
Sorry so long.

 

[turkinlight]

Title: Choose between image A or B | PANDA Requester: Yanping Xie [A2SOR5M00SWWMG] (Req TV): N/A (TO): [Pay: N/A] [Fair: N/A] [Comm: N/A] [Fast: N/A] Description: Choose between image A or B the more realistic one for 10 pairs of images Time: 2 minutes(s) HITs Available: 30 Reward: $0.20 Qualifications: High Quality DoesNotExist ; Masters Exists ;

Hurry, it's a good one with a short timer.

 

[Jerami]

Thanks, I'm already under 99% from just 3 rejections so now I'm more cautious lol

Who rejected you? Why? Have you asked to have them reversed?
Also, you may need to slow down, as far as individual HITs, especially if any were due to missing attention checks. That's a big no-no and shouldn't really be a reason for rejections very often. If it is, you are definitely not reading closely enough or doing HITs too quickly, and are missing stuff. If that's the case, you aren't providing quality data and it will be a continuing issue for you. This is not me trying to reprimand you. I'm only trying to help you to be able to turk for as long as you want and want to help you nip any problems in the bud, before you get too many rejections to come back from.
I'm happy to help in any way I can. If you want to PM me at some point to open a dialogue. So that we can make sure that you are set for success and, if problems arise, you'll have a reference to go back to. Plus, it helps so that questions and answers don't clog the 'Daily'(HITs thread) or get lost in the 'Help' section.

But, I'm here for you! Get an avatar first, so I can remember you by image, then PM me at some point today, if you want.

 

[greg]

Looks like today should have been called Summary Sunday, with everyone posting their stats