{"id":167,"date":"2020-01-28T23:38:21","date_gmt":"2020-01-28T23:38:21","guid":{"rendered":"http:\/\/wordpress.cs.vt.edu\/cs6724s20\/?p=167"},"modified":"2020-01-28T23:38:23","modified_gmt":"2020-01-28T23:38:23","slug":"01-29-20-ziyao-wang-beyond-mechanical-turk-an-analysis-of-paid-crowd-work-platforms","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/2020\/01\/28\/01-29-20-ziyao-wang-beyond-mechanical-turk-an-analysis-of-paid-crowd-work-platforms\/","title":{"rendered":"01\/29\/20 \u2013 Ziyao Wang \u2013 Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">The authors found that most of current research on crowd\nwork focused on AMT, and there is little exploration of other platforms. To\nenrich the diversity of crowd work researches and accelerate progress of\ndevelopment of crowd work, the authors contrast the key problems which they\nhave found in AMT versus features of other platforms. With the comparison, the\nauthors found different crowd platforms provide solution to different problems\nin AMT. However, all the platforms cannot provide sufficient support to well-designed\nworker analytics. Additionally, they made a conclusion that there is still a\nnumber of limitations in AMT and research on crowd work will benefit from\ndiversifying. With the contributions of the authors, future research on alternative\nplatforms can benefit from not considering AMT as the baseline.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Reflection:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AMT is the first platform for crowd work and many people are\nbenefit by using this platform. However, if all companies and workers only use\nAMT, the lack of diversity will result in a low development progress of crowd\nwork platform. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From AMT\u2019s point of view, if there are no other crowd work\nplatforms, it is hard for AMT to effectively find solutions to its limitations\nand problems. In this paper, for example, lack of automated tool is one of AMT\u2019s\nlimitations. However, the platform WorkFusion allows usage of machine automated\nworkers, which is an improvement to AMT. If there is only one platform, it is\nhard for the platform to find its limitation by itself. But with the competitor\nplatforms, to provide better user experience and defeat other adversary\ncompanies, they have to do a lot of research to keep their platforms up to\ndate. As a result, the research of crowd work will be pushed to develop rapidly.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For other platforms, they should not just copy the pattern\nof AMT. Though AMT is the most popular crowd work platform, it still has some\nlimitation. Other platforms can copy the advantages of AMT. However, they\nshould avoid AMT\u2019s limitations and find solutions to these drawbacks. A good\nbaseline can help the initiation of other platforms. But if other platforms are\njust totally follow the baseline, all the platforms will suffer from same\ndrawbacks and no one can propose any solution to them. To avoid this kind of\nsituation, the companies should develop own platforms, avoid the drawbacks and\nlearn advantages from other platforms.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The researchers should not just focus on AMT. Of course, the\nresearches on AMT will receive more attention as most of the users use AMT.\nHowever, it is harmful to the development of crowd work platform. Even some\nplatforms developed solutions for some problems, if the researchers just ignore\nthese platforms, these solutions will not be able to spread out and the\nresearchers and other companies will spend unnecessary effort to do research on\nsimilar solutions. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Question:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">What is the main reason for most of the companies select AMT\nas their crowd work service provider?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">What is the most significant advantage for each of the\nplatforms? Is there any chance to develop a platform which has all other\nplatforms\u2019 advantages?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Why most of the researchers focused on AMT only? Is it\npossible to advice more researchers to do cross-platform analysis?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The authors found that most of current research on crowd work focused on AMT, and there is little exploration of other platforms. To enrich the diversity of crowd work researches and accelerate progress of development of crowd work, the authors contrast the key problems which they have found in AMT versus features of other platforms. [&hellip;]<\/p>\n","protected":false},"author":297,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[43,28],"class_list":["post-167","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-beyondmturk","tag-class2"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/167","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/users\/297"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/comments?post=167"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/167\/revisions"}],"predecessor-version":[{"id":168,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/167\/revisions\/168"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/media?parent=167"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/categories?post=167"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/tags?post=167"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}