08/25 - Thankful for Turkopticon Thursday!

Status
Not open for further replies.

AlphaFemale

Active Member
Contributor
Joined
Jun 28, 2016
Messages
638
Reaction score
1,099
Points
468
Age
38
Location
West Virginia
Gender
Female
email I got from SuperCV

There are several reasons for why test takers will be rejected:

  • Non-US citizens will be rejected.

  • People who completed less than 95% of the GAT Test will be rejected.

  • People who failed more than 20% of the Attention Check Items will be rejected.

  • People who answered more than three GAT items in less than 5.000 milliseconds will be rejected (random guessing)

  • People who spent less than 1.5 standard deviations below average response time on the GAT test will be rejected.
We are tacking response times for each item on our validation website and your total response time was 28.64 minutes. The average response time that MTurkers spent on the test is 147.29 minutes (sd = 39.57). However, you are scoring more than 2 Standard Deviations below the average (that means, 90% of other MTurkers spent more time on the test). In order for our validation study data to be meaningful we need to ensure that test takers put full effort on our test so that their score reflects their real ability level.

Please let me know if you have any further questions.


So basically I'm guessing those who either sat on the test to let the time look better or took more breaks made the average time longer.
So they say you went fast, but they don't say if you scored as well as the people that took 2 1/2 hours to complete the test.
 
  • Like
Reactions: nikicollazo

Squatty

.
Contributor
Crowd Pleaser
HIT Poster
Joined
Mar 17, 2016
Messages
21,286
Reaction score
44,989
Points
2,538
Age
36
Gender
Female
email I got from SuperCV

There are several reasons for why test takers will be rejected:

  • Non-US citizens will be rejected.

  • People who completed less than 95% of the GAT Test will be rejected.

  • People who failed more than 20% of the Attention Check Items will be rejected.

  • People who answered more than three GAT items in less than 5.000 milliseconds will be rejected (random guessing)

  • People who spent less than 1.5 standard deviations below average response time on the GAT test will be rejected.
We are tacking response times for each item on our validation website and your total response time was 28.64 minutes. The average response time that MTurkers spent on the test is 147.29 minutes (sd = 39.57). However, you are scoring more than 2 Standard Deviations below the average (that means, 90% of other MTurkers spent more time on the test). In order for our validation study data to be meaningful we need to ensure that test takers put full effort on our test so that their score reflects their real ability level.

Please let me know if you have any further questions.


So basically I'm guessing those who either sat on the test to let the time look better or took more breaks made the average time longer.
I didn't cook it at all. I worked straight through with only one bathroom break.
 
Last edited:

Drwho10

Mister Gank Yo Hits
Contributor
Joined
Jan 11, 2016
Messages
12,350
Reaction score
20,568
Points
1,388
Age
32
Location
Long Beach, CA
Gender
Male
I didn't cook it at. I worked straight through with only one bathroom break.
how long did it take you working straight through? closer to 28minutes or the 147 ?
 

KellieS23

Anyone else feel like a Rainbow?
Contributor
Joined
Apr 6, 2016
Messages
6,287
Reaction score
10,331
Points
1,063
Location
Kansas
Gender
Female

zzzzzz...????...(*going back to bed*)
 

warriorwrath

Member
Contributor
Joined
Aug 16, 2016
Messages
139
Reaction score
312
Points
338
Age
32
Gender
Male
I didn't cook it at. I worked straight through with only one bathroom break.
yeah that confused me more because when you said you took less time than me I was like what. But it doesn't matter anymore just posted it so that if anyone else wakes up to a rejection they can see it and spare being sent the same email.
 
  • Like
Reactions: Squatty

MostlyConfused

Active Member
Joined
Aug 19, 2016
Messages
666
Reaction score
1,038
Points
143
Age
42
Gender
Female
email I got from SuperCV

There are several reasons for why test takers will be rejected:

  • Non-US citizens will be rejected.

  • People who completed less than 95% of the GAT Test will be rejected.

  • People who failed more than 20% of the Attention Check Items will be rejected.

  • People who answered more than three GAT items in less than 5.000 milliseconds will be rejected (random guessing)

  • People who spent less than 1.5 standard deviations below average response time on the GAT test will be rejected.
We are tacking response times for each item on our validation website and your total response time was 28.64 minutes. The average response time that MTurkers spent on the test is 147.29 minutes (sd = 39.57). However, you are scoring more than 2 Standard Deviations below the average (that means, 90% of other MTurkers spent more time on the test). In order for our validation study data to be meaningful we need to ensure that test takers put full effort on our test so that their score reflects their real ability level.

Please let me know if you have any further questions.


So basically I'm guessing those who either sat on the test to let the time look better or took more breaks made the average time longer.
I hope the Attention Checks are the super easy ones.
And now I'm worried I'm going to fast (My total time is like a day but time spent on each question might be short compared to whatever they are looking at) :arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh:
Also, what if I'm too dumb to get 95%??:cry::cry::cry::cry::cry::cry:
 

Squatty

.
Contributor
Crowd Pleaser
HIT Poster
Joined
Mar 17, 2016
Messages
21,286
Reaction score
44,989
Points
2,538
Age
36
Gender
Female
I hope the Attention Checks are the super easy ones.
And now I'm worried I'm going to fast (My total time is like a day but time spent on each question might be short compared to whatever they are looking at) :arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh:
Also, what if I'm too dumb to get 95%??:cry::cry::cry::cry::cry::cry:
95% answered.
 

Squatty

.
Contributor
Crowd Pleaser
HIT Poster
Joined
Mar 17, 2016
Messages
21,286
Reaction score
44,989
Points
2,538
Age
36
Gender
Female
yeah that confused me more because when you said you took less time than me I was like what. But it doesn't matter anymore just posted it so that if anyone else wakes up to a rejection they can see it and spare being sent the same email.
You said you took 2 hours, but they said 28 minutes?
 
  • Like
Reactions: Drwho10

Kizka

Non Serviam
Contributor
Joined
Jan 12, 2016
Messages
1,026
Reaction score
2,486
Points
588
Gender
Female
I hope the Attention Checks are the super easy ones.
And now I'm worried I'm going to fast (My total time is like a day but time spent on each question might be short compared to whatever they are looking at) :arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh::arghh:
Also, what if I'm too dumb to get 95%??:cry::cry::cry::cry::cry::cry:
I am as dumb as a rock and mine approved. Just do your best.
 

Drwho10

Mister Gank Yo Hits
Contributor
Joined
Jan 11, 2016
Messages
12,350
Reaction score
20,568
Points
1,388
Age
32
Location
Long Beach, CA
Gender
Male
yeah that confused me more because when you said you took less time than me I was like what. But it doesn't matter anymore just posted it so that if anyone else wakes up to a rejection they can see it and spare being sent the same email.
how'd you manage to blaze through it that fast ?
 
  • Like
Reactions: Squatty
Status
Not open for further replies.