Note: The schedule and readings below are tentative and subject to revision as the course progresses. Please check frequently for updates.<\/p>\n\n\n\n
January 22<\/strong> – Week 1<\/a><\/p>\n\n\n\n Welcome<\/p>\n\n\n\n Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass<\/a><\/em>. Houghton Mifflin Harcourt, Boston. Introduction and Chapter 1. [Read blog posts]<\/a><\/p>\n\n\n\n January 29<\/strong> – Week 2<\/a><\/p>\n\n\n\n Crowdsourcing<\/p>\n\n\n\n Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of Crowd Work<\/a>. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work<\/em> (CSCW \u201913), 1301\u20131318. [Read blog posts]<\/a><\/p>\n\n\n\n Donna Vakharia and Matthew Lease. 2015. Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms<\/a>. In iConference<\/em>, 17. [Read blog posts]<\/a><\/p>\n\n\n\n Human computation<\/p>\n\n\n\n Alexander J. Quinn and Benjamin B. Bederson. 2011. Human computation: a survey and taxonomy of a growing field<\/a>. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201911), 1403\u20131412. [Read blog posts]<\/a><\/p>\n\n\n\n R. Jordon Crouser and Remco Chang. 2012. An Affordance-Based Framework for Human Computation and Human-Computer Collaboration<\/a>. IEEE Transactions on Visualization and Computer Graphics<\/em> 18, 12: 2859\u20132868. [Read blog posts]<\/a><\/p>\n\n\n\n February 5<\/strong> – Week 3<\/a><\/p>\n\n\n\n Humans and ML<\/p>\n\n\n\n Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the People: The Role of Humans in Interactive Machine Learning<\/a>. AI Magazine<\/em> 35, 4: 105\u2013120. [Read blog posts]<\/a><\/p>\n\n\n\n Jennifer Wortman Vaughan. 2018. Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research<\/a>. Journal of Machine Learning Research<\/em> 18, 193: 1\u201346. [Read blog posts]<\/a><\/p>\n\n\n\n Interaction guidelines<\/p>\n\n\n\n Eric Horvitz. 1999. Principles of Mixed-initiative User Interfaces<\/a>. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201999), 159\u2013166. [Read blog posts]<\/a><\/p>\n\n\n\n Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction<\/a>. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201919), 1\u201313. [Read blog posts]<\/a><\/p>\n\n\n\n February 12 – <\/strong>Week 4<\/p>\n\n\n\n Initial presentations (pitches)<\/p>\n\n\n\n February 19<\/strong> – Week 5<\/a><\/p>\n\n\n\n Human-AI teams<\/p>\n\n\n\n Sharon Zhou, Melissa Valentine, and Michael S. Bernstein. 2018. In Search of the Dream Team: Temporally Constrained Multi-Armed Bandits for Identifying Effective Team Structures<\/a>. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201918), 1\u201313. [Read blog posts]<\/a><\/p>\n\n\n\n Gagan Bansal, Besmira Nushi, Ece Kamar, Daniel S. Weld, Walter S. Lasecki, and Eric Horvitz. 2019. Updates in Human-AI Teams: Understanding and Addressing the Performance\/Compatibility Tradeoff<\/a>. Proceedings of the AAAI Conference on Artificial Intelligence<\/em> 33, 01: 2429\u20132437. [Read blog posts]<\/a><\/p>\n\n\n\n Bots<\/p>\n\n\n\n R. Stuart Geiger and David Ribes. 2010. The work of sustaining order in wikipedia: the banning of a vandal<\/a>. In Proceedings of the 2010 ACM conference on Computer supported cooperative work<\/em>, 117\u2013126. [Read blog posts]<\/a><\/p>\n\n\n\n Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator<\/a>. ACM Transactions on Computer-Human Interaction (TOCHI)<\/em> 26, 5: 31:1\u201331:35. [Read blog posts]<\/a><\/p>\n\n\n\n February 26<\/strong> – Week 6<\/a><\/p>\n\n\n\n Explainable AI<\/p>\n\n\n\n Rafal Kocielnik, Saleema Amershi, and Paul N. Bennett. 2019. Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems<\/a>. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201919), 1\u201314. [Read blog posts]<\/a><\/p>\n\n\n\n Jonathan Dodge, Q. Vera Liao, Yunfeng Zhang, Rachel K. E. Bellamy, and Casey Dugan. 2019. Explaining models: an empirical study of how explanations impact fairness judgment<\/a>. In Proceedings of the 24th International Conference on Intelligent User Interfaces<\/em> (IUI \u201919), 275\u2013285. [Read blog posts]<\/a><\/p>\n\n\n\n Harmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana, Hanna Wallach, and Jennifer Wortman Vaughan. 2020. Interpreting Interpretability: Understanding Data Scientists\u2019 Use of Interpretability Tools for Machine Learning<\/a>. In CHI 2020<\/em>, 13. [Read blog posts]<\/a><\/p>\n\n\n\n March 4<\/strong> – Week 7<\/a><\/p>\n\n\n\n Images and sound<\/p>\n\n\n\n Kotaro Hara, Vicki Le, and Jon Froehlich. 2013. Combining crowdsourcing and google street view to identify street-level accessibility problems<\/a>. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201913), 631\u2013640. [Read blog posts]<\/a><\/p>\n\n\n\n Danna Gurari, Suyog Jain, Margrit Betke, and Kristen Grauman. 2016. Pull the Plug? Predicting If Computers or Humans Should Segment Images<\/a>. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)<\/em>, 2016,\u00a0382\u2013391. [Read blog posts]<\/a><\/p>\n\n\n\n Elliot Salisbury, Ece Kamar, and Meredith Ringel Morris. 2017. Toward Scalable Social Alt Text: Conversational Crowdsourcing as a Tool for Refining Vision-to-Language Technology for the Blind<\/a>. In Fifth AAAI Conference on Human Computation and Crowdsourcing<\/em>. [Read blog posts]<\/a><\/p>\n\n\n\n Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, and Jeffrey Bigham. 2012. Real-time captioning by groups of non-experts<\/a>. In Proceedings of the 25th annual ACM symposium on User interface software and technology<\/em> (UIST \u201912), 23\u201334. [Read blog posts]<\/a><\/p>\n\n\n\n March 11<\/strong> – Week 8<\/p>\n\n\n\n Spring Break (no class)<\/p>\n\n\n\n March 18<\/strong> – Week 9<\/p>\n\n\n\n Spring Break, continued (no class)<\/p>\n\n\n\n March 25<\/strong> – Week 10<\/a><\/p>\n\n\n\n Conversation<\/p>\n\n\n\n Prithvijit Chattopadhyay, Deshraj Yadav, Viraj Prabhu, Arjun Chandrasekaran, Abhishek Das, Stefan Lee, Dhruv Batra, and Devi Parikh. 2017. Evaluating Visual Conversational Agents via Cooperative Human-AI Games<\/a>. In Fifth AAAI Conference on Human Computation and Crowdsourcing<\/em>. [Read blog posts]<\/a><\/p>\n\n\n\n Ting-Hao (Kenneth) Huang, Joseph Chee Chang, and Jeffrey P. Bigham. 2018. Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time<\/a>. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201918), 1\u201313. [Read blog posts]<\/a><\/p>\n\n\n\n Q. Vera Liao, Muhammed Mas-ud Hussain, Praveen Chandar, Matthew Davis, Yasaman Khazaeni, Marco Patricio Crasso, Dakuo Wang, Michael Muller, N. Sadat Shami, and Werner Geyer. 2018. All Work and No Play? Conversations with a Question-and-Answer Chatbot in the Wild<\/a>. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201918), 1\u201313. [Read blog posts]<\/a><\/p>\n\n\n\n Ewa Luger and Abigail Sellen. 2016. \u201cLike Having a Really Bad PA\u201d: The Gulf between User Expectation and Experience of Conversational Agents<\/a>. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI \u201916)<\/em>. Association for Computing Machinery, New York, NY, USA, 5286\u20135297. [Read blog posts]<\/a><\/p>\n\n\n\n April 1<\/strong> – Week 11<\/p>\n\n\n\n Midpoint presentations<\/p>\n\n\n\n April 8<\/strong> – Week 12<\/a><\/p>\n\n\n\n Visualization<\/p>\n\n\n\n Jeffrey Rzeszotarski and Aniket Kittur. 2012. CrowdScape: interactively visualizing user behavior and output<\/a>. In Proceedings of the 25th annual ACM symposium on User interface software and technology<\/em> (UIST \u201912), 55\u201362. [Read blog posts] <\/a><\/p>\n\n\n\n A. Endert, W. Ribarsky, C. Turkay, B. L. William Wong, I. Nabney, I. D\u00edaz Blanco, and F. Rossi. 2017. The State of the Art in Integrating Machine Learning into Visual Analytics<\/a>. Computer Graphics Forum<\/em> 36, 8: 458\u2013486. [Read blog posts]<\/a><\/p>\n\n\n\n Jeffrey Heer. 2019. Agency plus automation: Designing artificial intelligence into interactive systems<\/a>. Proceedings of the National Academy of Sciences<\/em> 116, 6: 1844\u20131850. [Read blog posts]<\/a><\/p>\n\n\n\n April 15<\/strong> – Week 13<\/a><\/p>\n\n\n\n Truth and trust<\/p>\n\n\n\n Nicholas Diakopoulos. 2015. Algorithmic Accountability<\/a>. Digital Journalism<\/em> 3, 3: 398\u2013415. [Read blog posts]<\/a><\/p>\n\n\n\n An T. Nguyen, Aditya Kharosekar, Saumyaa Krishnan, Siddhesh Krishnan, Elizabeth Tate, Byron C. Wallace, and Matthew Lease. 2018. Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking<\/a>. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology<\/em> (UIST \u201918), 189\u2013199. [Read blog posts]<\/a><\/p>\n\n\n\n Kate Starbird, Ahmer Arif, and Tom Wilson. 2019. Disinformation as Collaborative Work: Surfacing the Participatory Nature of Strategic Information Operations<\/a>. Proceedings of the ACM on Human-Computer Interaction<\/em> 3, CSCW: 127:1\u2013127:26. [Read blog posts]<\/a><\/p>\n\n\n\n Michael Warren Skirpan, Tom Yeh, and Casey Fiesler. 2018. What\u2019s at Stake: Characterizing Risk Perceptions of Emerging Technologies<\/a>. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI \u201918)<\/em>. Association for Computing Machinery, New York, NY, USA, Paper 70, 1\u201312. [Read blog posts]<\/a><\/p>\n\n\n\n April 22<\/strong> – Week 14<\/a><\/p>\n\n\n\n Text analysis<\/p>\n\n\n\n Nathan Hahn, Joseph Chang, Ji Eun Kim, and Aniket Kittur. 2016. The Knowledge Accelerator: Big Picture Thinking in Small Pieces<\/a>. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201916), 2258\u20132270. [Read blog posts]<\/a><\/p>\n\n\n\n Joel Chan, Joseph Chee Chang, Tom Hope, Dafna Shahaf, and Aniket Kittur. 2018. SOLVENT: A Mixed Initiative System for Finding Analogies Between Research Papers<\/a>. Proc. ACM Hum.-Comput. Interact.<\/em> 2, CSCW: 31:1\u201331:21. [Read blog posts]<\/a><\/p>\n\n\n\n Soya Park, Amy X. Zhang, Luke S. Murray, and David R. Karger. 2019. Opportunities for Automating Email Processing: A Need-Finding Study<\/a>. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201919), 1\u201312. [Read blog posts]<\/a><\/p>\n\n\n\n April 29<\/strong> – Week 15<\/a><\/p>\n\n\n\n Creativity<\/p>\n\n\n\n C. Ailie Fraser, Mira Dontcheva, Holger Winnem\u00f6ller, Sheryl Ehrlich, and Scott Klemmer. 2016. DiscoverySpace: Suggesting Actions in Complex Software<\/a>. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems<\/em> (DIS \u201916), 1221\u20131232. [Read blog posts]<\/a><\/p>\n\n\n\n Pao Siangliulue, Joel Chan, Steven P. Dow, and Krzysztof Z. Gajos. 2016. IdeaHound: Improving Large-scale Collaborative Ideation with Crowd-Powered Real-time Semantic Modeling<\/a>. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology<\/em> (UIST \u201916), 609\u2013624. [Read blog posts] <\/a><\/p>\n\n\n\n Tom Hope, Joel Chan, Aniket Kittur, and Dafna Shahaf. 2017. Accelerating Innovation Through Analogy Mining<\/a>. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining<\/em> (KDD \u201917), 235\u2013243. [Read blog posts]<\/a><\/p>\n\n\n\n Lydia B. Chilton, Savvas Petridis, and Maneesh Agrawala. 2019. VisiBlends: A Flexible Workflow for Visual Blends<\/a>. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems<\/em> (CHI \u201919), 1\u201314. [Read blog posts]<\/a><\/p>\n\n\n\n May 6<\/strong> – Week 16<\/p>\n\n\n\n Final presentations<\/p>\n","protected":false},"excerpt":{"rendered":" Note: The schedule and readings below are tentative and subject to revision as the course progresses. Please check frequently for updates. January 22 – Week 1 Welcome Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, Boston. Introduction and Chapter 1. […]<\/p>\n","protected":false},"author":15,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-8","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/pages\/8","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/comments?post=8"}],"version-history":[{"count":36,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/pages\/8\/revisions"}],"predecessor-version":[{"id":1313,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/pages\/8\/revisions\/1313"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/media?parent=8"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n
\n\n\n\n