01/23 - Windy Wednesday

Status
Not open for further replies.

4ourfuture

Well-Known Member
Contributor
Joined
Jun 27, 2017
Messages
3,158
Reaction score
7,531
Points
838
Gender
Female
Try HIT Forker. You got panda buttons within the finder itself. It's not as easy to use but it works the same way HIT Finder does. I'm going to try it again now because it works so well with Panda Crazy.
At this point I'm thinking I'll give it a try as well. Thanks
 

WillowWolf

Mischief Managed
Contributor
Joined
Jul 28, 2016
Messages
1,800
Reaction score
5,343
Points
838
Gender
Female
I'm just happy things haven't exploded (yet).. which, if you're on the newest version of Forker you can actually help me test if you get done working for the day & wanna throw me a screenshot with this info:



I had TPG push an update this morning, so if you're still on the version from last night that fraction wont be there, but just in case figured I'd ask for the data :)
Is this what you need? I won't be done working until tonight (haven't done much today). Do you want me to send you another one later?
 
  • Like
Reactions: A6_Foul_Out

ChrisTurk

Member
Joined
May 25, 2016
Messages
379
Reaction score
1,499
Points
393
Actually I use Hit catcher for panda's now and Panda Crazy for search jobs only. The search jobs seems to be on a different timer than Panda's so it doesn't cause more pre's in my testing. I use overwatch for alerting to special requesters. Hit finder I'll use when I have a bad day and I need more hits. Hit Finder is a great way to find more requesters with batches. Just let it run for a few hours per day and then check the logged hits for any interesting batches that occur every day.
Just to clarify on this a bit wont this still cause issues with certain timings?

Correct me if I'm wrong but my understanding is the way PC runs its requester searches is by pulling up the requester's profile on MTurk (essentially typing the req name into the search box, but obviously using the rid link instead), if it doesn't see anything then no big deal (no problems in HIT Catcher).

However if it sees something, its gonna turn on a panda for it, and then you'll have problems if both timers are low & you have something running in Catcher?

Even if it doesn't see something running PC Search AND Finder at the low intervals should still cause PREs, just in the scraping of new HITs instead of the panda'ing of them.

The request pools are split, but this is still going to use too many in a # of scenarios. More or less trading off panda pool PREs for scraper pool PREs right?

Again, please let me know if I'm wrong I'm absolutely not intimately familiar with either set of tools (which is why I'm mostly asking! Its def a setup that makes a lot of sense if you have the timings done well) but I do know there are still some limits to running these kinds of things side-by-side and users who aren't aware of that may end up shooting themselves in the foot pretty heavily.
 

Michele

Working on degree in Moon
Contributor
HIT Poster
Joined
Feb 28, 2017
Messages
17,492
Reaction score
32,877
Points
1,388
Location
California
Gender
Female
Title: Spirituality and Reaction Time Task | Accept
Requester: SJC Psychology [A3HA5NHFY2XT68] Contact
TV: No Reviews
TO: [Pay=3.67] [Fast=5.00] [Comm=5.00] [Fair=5.00] [Reviews=4] [ToS=0]
TO2: No Reviews
Reward: 2.00
Duration: 30:00
Available: 1
Description: You will be asked to answer some questions about your spiritual beliefs and to complete a reaction time task.
Qualifications: None
[tr][td]
HIT exported from Mturk Suite v2.4.6
[/td][/tr]
[tr][td][/td][/tr]
 
  • Like
Reactions: cb456

WillowWolf

Mischief Managed
Contributor
Joined
Jul 28, 2016
Messages
1,800
Reaction score
5,343
Points
838
Gender
Female
That is actually exactly what I'd need! :) Hoping for very low #s on the left at the end of the day :ROFL:
Cool. I'll send you a screenshot tonight.I usually leave HIT forker running all day, so it should have a good 12 hours accumulated by then.
 

themildone

the real Jaded
Contributor
HIT Poster
Joined
Jan 12, 2016
Messages
19,285
Reaction score
46,776
Points
1,438
Age
29
Location
Indiana
Gender
Female
Title: Survey: Connecting Survey Responses to Career Interests(~ 15 minutes) | Accept
Requester: Neuropsychology of Decision Making [A37830J4PILJ7P] Contact
TV: No Reviews
TO: No Reviews
TO2: No Reviews
Reward: 1.00
Duration: 45:00
Available: 39
Description: Survey regarding how responses to a questionnaire are related to interest in certain types of careers. Participants will respond to a collection of survey items. The survey should take 15 minutes to complete. Compensation $1.00
Qualifications: HIT approval rate (%) GreaterThanOrEqualTo 80; Location In CA, US
[tr][td]
HIT exported from Mturk Suite v2.4.6
[/td][/tr]
[tr][td]
.[/td][/tr]
 
  • Like
Reactions: Michele

C to the J

Outlaw Turker
Contributor
Master Pleaser
Crowd Pleaser
HIT Poster
Joined
Jan 12, 2016
Messages
53,010
Reaction score
163,674
Points
3,238
Age
37
Gender
Male
Title: VR Sentiment analysis | Accept
Requester: Andrew [AH8G58PMHG840] Contact
TV: No Reviews
TO: No Reviews
Reward: 0.05
Duration: 3:00
Available: 595
Description: Customer comment analysis to document sentiment for their VR experience
Qualifications: HIT approval rate (%) GreaterThan 99; Location EqualTo US
[tr][td]
HIT exported from Mturk Suite v2.4.6
[/td][/tr]
[tr][td]
r[/td][/tr]
 

C to the J

Outlaw Turker
Contributor
Master Pleaser
Crowd Pleaser
HIT Poster
Joined
Jan 12, 2016
Messages
53,010
Reaction score
163,674
Points
3,238
Age
37
Gender
Male
Title: VR Sentiment analysis | Accept
Requester: Andrew [AH8G58PMHG840] Contact
TV: No Reviews
TO: No Reviews
Reward: 0.05
Duration: 3:00
Available: 595
Description: Customer comment analysis to document sentiment for their VR experience
Qualifications: HIT approval rate (%) GreaterThan 99; Location EqualTo US
[tr][td]
HIT exported from Mturk Suite v2.4.6
[/td][/tr]
[tr][td]
r[/td][/tr]
A batch for the rejectionless.
 

sofaslug

my cat's he-bitch
Joined
Jan 12, 2016
Messages
4,012
Reaction score
12,885
Points
763
Age
48
Location
Michigan
Gender
Male
Title: VR Sentiment analysis | Accept
Requester: Andrew [AH8G58PMHG840] Contact
TV: No Reviews
TO: No Reviews
Reward: 0.05
Duration: 3:00
Available: 595
Description: Customer comment analysis to document sentiment for their VR experience
Qualifications: HIT approval rate (%) GreaterThan 99; Location EqualTo US
[tr][td]
HIT exported from Mturk Suite v2.4.6
[/td][/tr]
[tr][td]
r[/td][/tr]
Dang. My 99.5228% approval rate isn't good enough for this.
 

Jamie Taylor

Member
Joined
Jan 9, 2019
Messages
309
Reaction score
404
Points
113
Try HIT Forker. You got panda buttons within the finder itself. It's not as easy to use but it works the same way HIT Finder does. I'm going to try it again now because it works so well with Panda Crazy.
How do you put HITs back, that HIT Forker grabs? I just used it, and it grabbed a ton of HITs that I don't want. PLEASE don't tell me I have to manually get rid of each one.
 

Minx2121

Well-Known Member
Joined
Jul 9, 2018
Messages
2,778
Reaction score
5,816
Points
763
Age
34
Gender
Female
Well I was catching a handful but seems to have slowed down a bit :(
 

Mr_AvocadoMan

Active Member
Joined
Jul 13, 2018
Messages
586
Reaction score
1,280
Points
143
Age
27
Location
Las Vegas
Gender
Male
How do you put HITs back, that HIT Forker grabs? I just used it, and it grabbed a ton of HITs that I don't want. PLEASE don't tell me I have to manually get rid of each one.
I have no idea. I'd just do the ones you have time for and leave the rest to expire.
 

Johnnyrs

Active Member
Contributor
Crowd Pleaser
Joined
Jan 12, 2016
Messages
546
Reaction score
1,603
Points
668
Age
54
Location
Whittier, California
Gender
Male
Just to clarify on this a bit wont this still cause issues with certain timings?

Correct me if I'm wrong but my understanding is the way PC runs its requester searches is by pulling up the requester's profile on MTurk (essentially typing the req name into the search box, but obviously using the rid link instead), if it doesn't see anything then no big deal (no problems in HIT Catcher).

However if it sees something, its gonna turn on a panda for it, and then you'll have problems if both timers are low & you have something running in Catcher?

Even if it doesn't see something running PC Search AND Finder at the low intervals should still cause PREs, just in the scraping of new HITs instead of the panda'ing of them.

The request pools are split, but this is still going to use too many in a # of scenarios. More or less trading off panda pool PREs for scraper pool PREs right?

Again, please let me know if I'm wrong I'm absolutely not intimately familiar with either set of tools (which is why I'm mostly asking! Its def a setup that makes a lot of sense if you have the timings done well) but I do know there are still some limits to running these kinds of things side-by-side and users who aren't aware of that may end up shooting themselves in the foot pretty heavily.
Yes that is how it works. But when the new mturk changes happened last year they change something so that panda's and searches won't interfere with each other and cause PRE's. I found this out last year around August by accident. I am sure if running too many searches at once will cause PRE's but it seems to have it's own limits now.

So if you run a search on a batch that runs all day then yes you would be correct that you'll be getting more PRE's which would defeat the purpose because it would be running panda's all the time interfering with other panda's. Now I have one Panda Crazy window on my second computer that runs only searches for stuff that comes out once or twice a day sometimes like C-sats, pinterest or ipsoft. At the same time I have Hit Catcher run on my main computer at a speed of 1000ms on a batch that runs all day. The PRE's on Panda Crazy shows 0. Hit Catcher shows less than 50 but I've been trying to catch some surverys today too. I even tested Panda Crazy running only searches at 700ms and still get no PRE's or very few.

Of course when the searches find hits than the PRE's will start causing problems and it's best to turn off Panda's at that time if you can. Many times I don't and understand I might get less.
 
  • Like
Reactions: ChrisTurk
Status
Not open for further replies.