08/16 - Tactile Thursday!

Status
Not open for further replies.

stuffalleysays

I was here
Contributor
Joined
Sep 9, 2017
Messages
3,898
Reaction score
7,227
Points
838
Age
51
Location
IOWA
Gender
Female
Here is her response to my response,lol. Notice she is dealing with people trying to scam the system, come on people! I apologized for the workers, and I encouraged her to reach out on the requester thread to help her research process run more smoothly.

Hi Alicia,

I'll check and get back to you about this HIT later today or tomorrow. I'm evaluating the last 2 batches now.

I have got a lot of spam responses in the HITs. A lot of rejections were because the review was copy-pasted in its entirely to the answer field - that is obviously not the task.
I'm being careful about the rejections - I understand that this affects your overall rating for other tasks as well.

Best,
Rose.
 
Last edited:

stuffalleysays

I was here
Contributor
Joined
Sep 9, 2017
Messages
3,898
Reaction score
7,227
Points
838
Age
51
Location
IOWA
Gender
Female
Title: Compensation HIT(~ 1 minutes) | Accept
Requester: Empirical Jury [A2QGI2L47S8HB0] Contact
TV: [Hrly=$13.76] [Pay=4.25] [Fast=3.33] [Comm=2.00] [Rej=0] [ToS=0] [Blk=0]
TO: [Pay=3.46] [Fast=3.09] [Comm=2.27] [Fair=3.18] [Reviews=67] [ToS=0]
TO2: [Hrly=10.86] [Pen=3.55 days] [Res=0%] [Rec=77%] [Rej=1] [ToS=0] [Brk=0]
Reward: 7.50
Duration: 1800
Available: 1
Description: survey
Qualifications: Inc: [19-102500] Exists
[tr][td]
HIT exported from Mturk Suite v2.3.7
[/td][/tr]
[tr][td][/td][/tr]
 

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
Hahaha, truuue that's what everyone wanted yesterday
:angelic:

there's a reason the ninjas are the far superior bearers of IPsofts.

Using a closed qual for stuff that isn't as dependent on the most varied, widest amount of responses would just be a nice thing to do for your good workers. The qual doesn't even need to be all that exclusive, just limited to people who have shown that they actually speak English.
 
Last edited:

IPsoft AWS Account

Active Member
Requester
Crowd Pleaser
Joined
Nov 4, 2016
Messages
513
Reaction score
4,025
Points
693
Location
NYC
:angelic:

there's a reason the ninjas are the far superior bearers of IPsofts.

Using a closed qual for stuff that isn't as dependent on the most varied, widest amount of responses would just be a nice thing to do for your good workers. The qual doesn't even need to be all that exclusive, just limited to people who shown they are actual competent English speakers in the past.
Yeah, I think I'm gonna do something like that. I'm just working out how the csv files work.
If only I had bothered to keep up with the Gold Club qual. But it's still a nice list of who was good a few months ago.
 

rsclone

This is my partner Fellatio Del Toro
Banned
Joined
Dec 17, 2016
Messages
6,128
Reaction score
12,435
Points
988
Yeah, I think I'm gonna do something like that. I'm just working out how the csv files work.
If only I had bothered to keep up with the Gold Club qual. But it's still a nice list of who was good a few months ago.
I have a Gold Club loyalty card...is that close enough??
 

Michele

Working on degree in Moon
Contributor
HIT Poster
Joined
Feb 28, 2017
Messages
17,492
Reaction score
32,878
Points
1,388
Location
California
Gender
Female
Title: Survey on users' perceptions about Internet privacy (15 mins) ($1 + bonus $1) | Accept
Requester: Internet Study Group [A3B8YUBHP5F7CS] Contact
TV: No Reviews
TO: [Pay=5.00] [Fast=0.00] [Comm=0.00] [Fair=0.00] [Reviews=1] [ToS=0]
TO2: [Hrly=20.00] [Pen=null] [Res=null] [Rec=null] [Rej=0] [ToS=0] [Brk=0]
Reward: 1.00
Duration: 1800
Available: 1
Description: Survey on users' perceptions about Internet privacy (15 mins) ($1 + bonus $1)
Qualifications: HIT approval rate (%) GreaterThan 97; Location EqualTo US
[tr][td]
HIT exported from Mturk Suite v2.3.7
[/td][/tr]
[tr][td][/td][/tr]
 

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
Yeah, I think I'm gonna do something like that. I'm just working out how the csv files work.
If only I had bothered to keep up with the Gold Club qual. But it's still a nice list of who was good a few months ago.
pinterest does something similar with their data collection, and their data collection similarly relies on several inputs per given piece of data.

banning the scammers (qual86)

mitigating the bad data of the people who try, but their data isn't the best

and collecting as much great data from good workers as they can. (gold club)

while at the same time, taking advantage of Turk's strengths with its vast array of workers.

https://medium.com/@Pinterest_Engin...ve-crowdsourcing-at-your-company-6f19df729a89
 

tricker

Well-Known Member
Contributor
Joined
Jan 12, 2016
Messages
9,279
Reaction score
19,141
Points
1,063
Location
California
Gender
Female
Yeah, I think I'm gonna do something like that. I'm just working out how the csv files work.
If only I had bothered to keep up with the Gold Club qual. But it's still a nice list of who was good a few months ago.


Lots of us with that qual are still here!!
 

SherryNotShirley

Well-Known Member
Contributor
Joined
Nov 17, 2017
Messages
1,846
Reaction score
5,782
Points
838
Gender
Female
Gotta love it when those promised bonuses actually come in.

Greetings from Amazon Mechanical Turk,

You've received a bonus from M Takarangi, D Strange for work related to 33CLA8O0MIB3ASPJUWX0DS4PI1LRFQ.
The value of your bonus is: $4.95 USD
 

IPsoft AWS Account

Active Member
Requester
Crowd Pleaser
Joined
Nov 4, 2016
Messages
513
Reaction score
4,025
Points
693
Location
NYC
pinterest does something similar with their data collection, and their data collection similarly relies on several inputs per given piece of data.

banning the scammers (qual86)

mitigating the bad data of the people who try, but their data isn't the best

and collecting as much great data from good workers as they can. (gold club)

while at the same time, taking advantage of Turk's strengths with its vast array of workers.

https://medium.com/@Pinterest_Engin...ve-crowdsourcing-at-your-company-6f19df729a89
Oh, nice! That's what I was working on figuring out how to do when I created the gold club qual, but then it didn't end up making sense for the small-ish volume of data we're collecting. And none of the quality measures I was trying out on paraphrase data really correlated well with my idea of high/medium/low quality paraphrases so.... We just check them for a number of things and go with it. But I wanted a more automated, fancy process!
 

Jerami

Well-Known Member
Contributor
Crowd Pleaser
HIT Poster
Joined
Jan 24, 2016
Messages
14,405
Reaction score
25,210
Points
2,238
Title: Daily Judgments(~ 3 minutes) | Accept
Requester: Allon Vishkin [AUXSHBH4XPLAO] Contact
TV: [Hrly=$12.92] [Pay=4.00] [Fast=null] [Comm=null] [Rej=0] [ToS=0] [Blk=0]
TO: [Pay=5.00] [Fast=4.50] [Comm=0.00] [Fair=5.00] [Reviews=7] [ToS=0]
TO2: [Hrly=6.00] [Pen=0.04 days] [Res=null] [Rec=100%] [Rej=0] [ToS=0] [Brk=0]
Reward: 0.30
Duration: 1800
Available: 2
Description: Quick survey assessing daily judgments, 3 minutes, $0.30
Qualifications: Exc: [103042-102453] DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 100; Total approved HITs LessThanOrEqualTo 50000; HIT approval rate (%) GreaterThanOrEqualTo 99; Location In US
[tr][td]
HIT exported from Mturk Suite v2.3.7
[/td][/tr]
[tr][td][/td][/tr]
 

Starslip

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 19, 2016
Messages
13,351
Reaction score
35,529
Points
1,588
Age
124
Gender
Male
Is anyone else stuck on a certain page on the Sarah Cogswell Microsoft Calendar HIT or am I just completely missing how to respond correctly??
Yes, seems broken. What'd you do, return it?
 
  • Like
Reactions: rsclone
Status
Not open for further replies.