{"id":379,"date":"2017-12-04T18:44:27","date_gmt":"2017-12-04T18:44:27","guid":{"rendered":"http:\/\/wordpress.cs.vt.edu\/cs6724f17\/?p=379"},"modified":"2017-12-12T01:41:27","modified_gmt":"2017-12-12T01:41:27","slug":"tech-demo-legiontools","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/2017\/12\/04\/tech-demo-legiontools\/","title":{"rendered":"Tech Demo: LegionTools"},"content":{"rendered":"

\"\"<\/p>\n

Paper: <\/span><\/strong><\/p>\n

W.S. Lasecki, M. Gordon, D. Koutra, M.F. Jung, S.P. Dow and J.P. Bigham. Glance: Rapidly Coding Behavioral Video with the Crowd.\u00a0In Proceedings of the ACM Symposium on User Interface Software and Technology<\/i>\u00a0(UIST 2014).<\/p>\n

Brief Overview:<\/strong><\/span><\/p>\n

When running studies on Amazon Mechanical Turk, we often need a large number of workers in a short amount of time: either to get survey responses quickly or for real-time and synchronous tasks. LegionTools is the answer to this problem. It is a toolkit and interface that can set up a HIT on MTurk through an algorithm that posts and expires a steady stream of HITs (that all point to the same task), to quickly gather a large number of Turkers.<\/p>\n

It can also pool these workers in a “waiting room” of sorts, and a selected subset (or all) of these workers can be routed to a real-time synchronous task, with the push of a button.<\/p>\n

Download Link:<\/strong><\/span>\u00a0https:\/\/github.com\/cromaLab\/LegionTools or\u00a0http:\/\/rochci.github.io\/LegionTools\/<\/p>\n

Steps (taken from LegionTools GitHub page<\/a>)<\/strong><\/span>:<\/p>\n

    \n
  1. Add a new task by typing a unique session name, title, description, keywords, and clicking\u00a0Add new task<\/code>. Remember your session name, you can use it to pull up your session later on.<\/li>\n
  2. Set the target number of workers. Set the price range and click “Update price”.<\/li>\n
  3. Click\u00a0Change waiting page instructions<\/code>\u00a0to edit the text that workers will be shown while waiting for your task.<\/li>\n
  4. Click\u00a0Start recruiting<\/code>\u00a0to beging recruiting.\u00a0You must click\u00a0Stop recruiting<\/code>\u00a0to end the recruiting process<\/strong>. Note that stopping recruitment will take some time, depending on your target number of workers.<\/li>\n
  5. Pull up a previous task using just your task session name. If you closed the UI page and left the recruiting tool running, you may stop that recruiting process by loading the associated session and clicking\u00a0Stop recruiting<\/code>.<\/li>\n
  6. Modify task title, description, and keywords with\u00a0Update<\/code>. Changes automatically affect all new HITs posted by the recruiting tool.<\/li>\n
  7. Send workers to a URL with the Fire button.\u00a0Your chosen URL must be\u00a0HTTPS<\/code><\/strong>.<\/li>\n
  8. When you are ready to review completed HITs, click\u00a0Reload<\/code>\u00a0in the\u00a0Overview<\/code>\u00a0section to load all reviewable HITs associated with a given task session.<\/li>\n<\/ol>\n

     <\/p>\n","protected":false},"excerpt":{"rendered":"

    Paper: W.S. Lasecki, M. Gordon, D. Koutra, M.F. Jung, S.P. Dow and J.P. Bigham. Glance: Rapidly Coding Behavioral Video with the Crowd.\u00a0In Proceedings of the ACM Symposium on User Interface Software and Technology\u00a0(UIST 2014). Brief Overview: When running studies on Amazon Mechanical Turk, we often need a large number of workers in a short amount […]<\/p>\n","protected":false},"author":96,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-379","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/posts\/379","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/users\/96"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/comments?post=379"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/posts\/379\/revisions"}],"predecessor-version":[{"id":382,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/posts\/379\/revisions\/382"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/media?parent=379"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/categories?post=379"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f17\/wp-json\/wp\/v2\/tags?post=379"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}