08/21 - Tensorflow Tuesday!

Status
Not open for further replies.

TSolo315

SnapNCrackle
Administrator
Joined
Jan 12, 2016
Messages
5,000
Reaction score
16,977
Points
2,538
Gender
Male
I don't do underpaid work.

I have a few bad reviews for stuff I knew was shit going into it, but the vast, vast majority of surveys I do are > 12/hour
So I haven't left HIT reviews for a long time and am a little out of the loop on how it works, but I guess what I'm getting at is if people aren't leaving enough bad reviews for shitty HITs it significantly weakens the power of the system.

Are there enough people trudging though the shitty work to leave the bad reviews? Can you leave a review on a HIT you realize is shitty but don't finish?
 

Starslip

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 19, 2016
Messages
13,351
Reaction score
35,529
Points
1,588
Age
124
Gender
Male
Can you leave a review on a HIT you realize is shitty but don't finish?
I'm actually uncertain about that too. It looks like no, since you can't leave reviews directly on the tv site but have to do it through the addon, which only logs the HIT to be reviewed after you finish. Am I wrong?
 
  • Like
Reactions: TSolo315

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
if people aren't leaving enough bad reviews for shitty HITs it significantly weakens the power of the system.
I mean your brain is the first line of defense.
If it looks, smells, and appears to be garbage, you likely don't need a TV review to tell you what you've already figured out.

After that, most survey stuff that appears reasonable to do gets reviewed. I'm not a person to get suckered into doing crap, or finishing it often, but some people do. You can't review stuff you haven't done, that'd just lead to more abuse than it's worth.

Are there enough people trudging though the shitty work to leave the bad reviews?
enough people are treading through the 8-12$ crap so that you can avoid it, yes.

Should you check a 8-12$/hourly review to make sure somebody kinda slow hasn't done it? probably.

anything paying less you should be able to discern just using your brain/experience.
 
Last edited:

Michele

Working on degree in Moon
Contributor
HIT Poster
Joined
Feb 28, 2017
Messages
17,492
Reaction score
32,877
Points
1,388
Location
California
Gender
Female
Title: User Test, Requires Mic, Windows or Mac, 836a3129 | Accept
Requester: SoundingBox (Change Sciences Group) [A1DIWKR9NEY82N] Contact
TV: [Hrly=$11.47] [Pay=4.00] [Fast=4.00] [Comm=null] [Rej=0] [ToS=0] [Blk=0]
TO: [Pay=3.41] [Fast=3.87] [Comm=3.59] [Fair=4.12] [Reviews=158] [ToS=24]
TO2: [Hrly=6.82] [Pen=0.25 days] [Res=100%] [Rec=38%] [Rej=0] [ToS=0] [Brk=3]
Reward: 10.00
Duration: 7200
Available: 1
Description: Perform a user test on a website. It's fun and your opinion matters! Microphone required.
Qualifications: StudyGroupExclusion - c81eeab9-9a03-4dd6-b78a-c3172e39a2d8 DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 1000; HIT approval rate (%) GreaterThanOrEqualTo 97; Location In US
[tr][td]
HIT exported from Mturk Suite v2.3.7
[/td][/tr]
[tr][td][/td][/tr]
 

Starslip

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 19, 2016
Messages
13,351
Reaction score
35,529
Points
1,588
Age
124
Gender
Male
I can't catch a damned thing
 
  • Like
Reactions: NemoRolls

TSolo315

SnapNCrackle
Administrator
Joined
Jan 12, 2016
Messages
5,000
Reaction score
16,977
Points
2,538
Gender
Male
I mean your brain is the first line of defense.
If it looks, smells, and appears to be garbage, you likely don't need a TV review to tell you what you've already figured out.

After that, most survey stuff that appears reasonable to do gets reviewed. I'm not a person to get suckered into doing crap, or finishing it often, but some people do. You can't review stuff you haven't done, that'd just lead to more abuse than it's worth.


enough people are treading through the 8-12$ crap so that you can avoid it, yes.

anything paying less you should be able to discern just using your brain/experience.
I mean I agree, but you and me have a lot of experience with this kind of thing and can make good educated guesses to the quality of a survey. For newbies (the primary users of these review services) seeing the red $4.00/hr would be pretty helpful -- but that would require someone (hopefully several someones) to leave that review.

Just to be clear I'm not judging you for not completing shitty surveys to leave bad reviews :blep:

I do think this is a flaw in the system though that could be improved on, you should be able to leave reviews for unfinished HITs.
 

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
  • Like
Reactions: TSolo315

C to the J

Outlaw Turker
Contributor
Master Pleaser
Crowd Pleaser
HIT Poster
Joined
Jan 12, 2016
Messages
52,894
Reaction score
163,507
Points
3,238
Age
37
Gender
Male
I mean I agree, but you and me have a lot of experience with this kind of thing and can make good educated guesses to the quality of a survey. For newbies (the primary users of these review services) seeing the red $4.00/hr would be pretty helpful -- but that would require someone (hopefully several someones) to leave that review.

Just to be clear I'm not judging you for not completing shitty surveys to leave bad reviews :blep:

I do think this is a flaw in the system though that could be improved on, you should be able to leave reviews for unfinished HITs.
Ideally requesters could just be accurate with their estimates in the first place.
Though I do love the surprise when a survey says 60 min and it takes 8.
 
Status
Not open for further replies.