{"id":282,"date":"2020-02-05T14:20:09","date_gmt":"2020-02-05T14:20:09","guid":{"rendered":"http:\/\/wordpress.cs.vt.edu\/cs6724s20\/?p=282"},"modified":"2020-02-05T14:20:11","modified_gmt":"2020-02-05T14:20:11","slug":"02-05-20-myles-frantz-guidelines-for-human-ai-interaction","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/2020\/02\/05\/02-05-20-myles-frantz-guidelines-for-human-ai-interaction\/","title":{"rendered":"02\/05\/20 \u2013 Myles Frantz \u2013 Guidelines for Human-AI Interaction"},"content":{"rendered":"\n<p>Through this paper, the various Microsoft authors created, and survey tested a set of guide lines (or best approaches) for designing and creating AI Human interactions. Throughout their study, they went through 150 AI design recommendations, ran their initial set of guidelines through a strict set of heuristics, and finally through multiple rounds in user study consisting of 49 moderates (with at least 1 year of self-reported experience) HCI practitioners. From this, the resulting 18 guidelines had the categories of \u201cInitially\u201d (at the start of development), \u201cDuring interaction\u201d, \u201cWhen wrong\u201d (the ai system), and \u201cOver time\u201d. These categories include some of the following (but not limited to): \u201cMake clear what the system can do\u201d, \u201cSupport efficient invocation\u201d, and \u201cRemember recent interactions\u201d. Throughout the user study, these guidelines were tested to how relevant they would be in the specific avenue of technology (such as Navigation and Social Networks). Throughout these ratings, at least 50% of the respondents thought the guidelines were clear, while approximately 75% of the resonant thought the guidelines were at least neutral (or all right to understand). Finally, a set of HCI experts were asked to ensure further revisions on the guidelines were accurate and better reflected the area.<\/p>\n\n\n\n<p>I agree and really appreciate the insight into the relevancy\ntesting of each guideline on each section of industry. Not only does this help\nto avoid mis-appropriation of guidelines into unintended sections, it also\nhelps create a guideline for the guidelines. This will help ensure people\nimplementing these set of guidelines have a better idea as to the best place\nthey could be used.<\/p>\n\n\n\n<p>I also agree and like the thorough testing that went into\nthe vetting process for these guidelines. Within last weeks readings it seems\nthe surveys were majority or solely based on the surveys of papers and subjective\nto the authors. Having various rounds of testing with people who have generally\nhigh average of experience within the field grants great support to the\nguidelines.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>One of my questions for the authors would be a post-mortem of the results and their impact upon the industry. Regardless of the citations it would be interesting to see how many platforms integrate these guidelines into their systems and to what extent.<\/li><li>Following up on the previous question, I would like to see another paper (possibly survey) exploring the different methods of implementations used throughout the different platform. A comparison between the different platforms would help to better showcase and exemplify each guideline.<\/li><li>I would also like to see each of these guidelines run against a sample of expert psychologists and determine their affects in the long run. Along with what was described in the paper (Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research) as algorithm aversion (\u201ca phenomenon in which people fail to trust an algorithm once they have seen the algorithm make a mistake\u201d), I would like to see if these guidelines would create an environment making the interaction to immersive that the human subjects are either rejecting it or completely accepting of it.<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Through this paper, the various Microsoft authors created, and survey tested a set of guide lines (or best approaches) for designing and creating AI Human interactions. Throughout their study, they went through 150 AI design recommendations, ran their initial set of guidelines through a strict set of heuristics, and finally through multiple rounds in user [&hellip;]<\/p>\n","protected":false},"author":289,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[46,48],"class_list":["post-282","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-class3","tag-hai_guidelines"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/282","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/users\/289"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/comments?post=282"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/282\/revisions"}],"predecessor-version":[{"id":283,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/282\/revisions\/283"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/media?parent=282"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/categories?post=282"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/tags?post=282"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}