{"id":4,"date":"2015-08-26T21:14:51","date_gmt":"2015-08-26T21:14:51","guid":{"rendered":"http:\/\/wordpress.cs.vt.edu\/cs6724f15\/?p=4"},"modified":"2015-08-26T21:14:51","modified_gmt":"2015-08-26T21:14:51","slug":"the-future-of-crowd-work","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/2015\/08\/26\/the-future-of-crowd-work\/","title":{"rendered":"The Future of Crowd Work"},"content":{"rendered":"<p>Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In <em>Proceedings of the 2013 conference on Computer supported cooperative work<\/em> (CSCW &#8217;13). ACM, New York, NY, USA, 1301-1318. DOI=10.1145\/2441776.2441923 http:\/\/doi.acm.org\/10.1145\/2441776.2441923<\/p>\n<p><strong>Summary<\/strong><\/p>\n<p><span style=\"font-weight: 400\">In this paper, the authors ask the provocative question, \u201ccan we foresee a future crowd workplace in which we would want our children to participate?\u201d To address this question, they review a large body of literature on crowdsourcing (over 100 papers) and incorporate commentary from a survey of 104 US and Indian crowd workers. The authors start with a consideration of tradeoffs of crowd worker vs. traditional work, and then synthesize 12 foci or challenges to the future of crowd work that are especially important. For each focus, the authors describe the goals, review some related work, and offer a proposal for what the future of crowd work should entail. The foci are crowd processes (workflow, task assignment, hierarchy, realtime, synchronous, and quality control); crowd computation (crowds guiding AIs, AIs guiding crowds, and platforms); and crowd workers (job design, reputation and credentials, and motivations and rewards). They conclude with 3 design goals that span multiple foci to provide clear step forwards. The first is to create career ladders that allow workers to advance to more complex and rewarding roles. The second is to help requesters design better tasks that workers will understand and enjoy more. The third is to facilitate learning, which offers the dual benefits of providing workers with new skills and requesters with the talent needed to complete their tasks. The authors conclude by emphasizing that both system design and careful study of the effects are needed, but crowd work provides an exciting new opportunity: to explore radically new kinds of organizations in a controlled experimental setting.<\/span><\/p>\n<p><strong>Reflection<\/strong><\/p>\n<p><span style=\"font-weight: 400\">This is an ambitious paper that covers a lot of ground (over quite a few pages), but it\u2019s all valuable, important stuff. The challenge to imagine a future where we\u2019d want ourselves or our children to be crowd workers is a wonderful provocation. At first it seems hard to imagine, maybe because I\u2019ve seen so many unpleasant crowd tasks. But on further reflection, it\u2019s an exciting vision of the future&#8211;one where people can, from the comfort of their homes, find any kind of work they want to do, and engage with it in a way that is financially rewarding and personally satisfying. I also appreciated the authors\u2019 efforts at synthesizing such a large and diverse range of crowdsourcing papers. Just summarizing what\u2019s been done is helpful per se, but the authors go much further by pointing out the drawbacks and opportunities to do better. I\u2019m simultaneously amazed at the amount of crowdsourcing research that\u2019s been conducted in just a few short years, and surprised at how much is still left to do. For example, the authors note that we have almost no idea if \u201calgorithmic management\u201d is better than traditional management techniques&#8211;what an interesting question. I find this inspiring as a researcher in this area. Finally, I appreciated that the authors raised some of the ethical concerns of working in this area, such as fair compensation, privacy, and power dynamics. I think they could have gone even further here. While I agree that all the foci are important, I think maybe the ethical concerns supercede all of them, or at least need to be embedded in each of them. Everything from quality control to hierarchies to AI-guided crowds raises serious questions about ethics and morality that need to be seriously considered from day one.<\/span><\/p>\n<p><strong>Questions<\/strong><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Would you want to be a crowd worker? Your children? Why or why not? What do you think is needed to make that vision a reality?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">What are some of the potential advantages of crowd work over traditional work? Disadvantages?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">What was a focus\/challenge that you found particularly exciting or interesting? One that seemed especially difficult or hard to realize?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">How could we make crowd labor more appealing than current traditional jobs?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Some of the proposals in the paper make crowd work look more like traditional work. If we follow this line of thinking, will we end up with something that looks just like today\u2019s traditional jobs? Why or why not?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Did any of the proposals in the paper strike you as being particularly ethically worrisome? Why?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">As you begin thinking about your project idea, which of these foci do you think you might contribute to?<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW &#8217;13). ACM, New York, NY, USA, 1301-1318. DOI=10.1145\/2441776.2441923 http:\/\/doi.acm.org\/10.1145\/2441776.2441923 Summary In this paper, the authors ask the provocative question, [&hellip;]<\/p>\n","protected":false},"author":15,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/posts\/4","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/comments?post=4"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/posts\/4\/revisions"}],"predecessor-version":[{"id":5,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/posts\/4\/revisions\/5"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/media?parent=4"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/categories?post=4"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724f15\/wp-json\/wp\/v2\/tags?post=4"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}