{"id":360,"date":"2020-02-05T14:41:34","date_gmt":"2020-02-05T14:41:34","guid":{"rendered":"http:\/\/wordpress.cs.vt.edu\/cs6724s20\/?p=360"},"modified":"2020-02-05T14:41:35","modified_gmt":"2020-02-05T14:41:35","slug":"2-5-20-lee-lisle-guidelines-for-human-ai-interaction","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/2020\/02\/05\/2-5-20-lee-lisle-guidelines-for-human-ai-interaction\/","title":{"rendered":"2\/5\/20 – Lee Lisle – Guidelines for Human-AI Interaction"},"content":{"rendered":"\n

Summary<\/strong><\/p>\n\n\n\n

               The\nauthors (of which there are many) go over the various HCI-related findings for\nHuman-AI interaction and categorize them into eighteen different types over 4\ncategories (applicable to when the user encounters the AI assistance). The work\nmakes sure the reader knows it was from the past twenty years of research and\nfrom a review of industry guidelines, articles and editorials in the public\ndomain, and a (non-exhaustive) survey of scholarly papers on AI design. In all,\nthey found 168 guidelines that they then performed affinity diagramming (and\nfiltering out concepts that were too \u201cvague\u201d), resulting in twenty concepts.\nEleven members of their team at Microsoft then performed a modified discount\nheuristic evaluation (where they identified an application and its issue) and\nrefined their guidelines with that data, resulting in 18 rules. Next, they\nperformed a user study with 49 HCI experts where each was given an AI-tool and\nasked to evaluate it. Lastly, they had experts validate their revisions in the\nprevious phase.<\/p>\n\n\n\n

Personal Reflection<\/strong><\/p>\n\n\n\n

               These\nguidelines are actually quite helpful in evaluating an interface. As someone\nwho has performed several heuristic evaluations in a non-class setting, having\ndefined rules that can be easily determined if they\u2019ve been violated makes the\nprocess significantly quicker. Nielsen\u2019s heuristics have been the gold standard\nfor perhaps too long, so revisiting the creation of guidelines is ideal. It\nalso speaks to how new this paper is, being from 2019\u2019s CHI conference.<\/p>\n\n\n\n

               Various\nthings surprised me in this work. First, I was surprised that they stated that\ncontractions weren\u2019t allowed for their guidelines because they weren\u2019t clear. I\nhaven\u2019t heard that complaint before, and it seemed somewhat arbitrary. A\ncontraction doesn\u2019t change a sentence much (doesn\u2019t in this sentence is clearly\n\u201cdoes not\u201d), but I may be mistaken here. I was also surprised to find their\ntables in figure 1 to be hard to read, as if maybe it as a bit too information\ndense to clearly impart their findings. I was also surprised about their\nexample for guideline 6, as suggesting personal pronouns and kind of stating\nthere are only 2 is murky, at best (I would\u2019ve used a different example\nentirely). Lastly, the authors completely ignored the suggestion of keeping the\nold guideline 15, stating their own reasons despite the expert\u2019s preferences.<\/p>\n\n\n\n

               I also\nthink this paper in particular will be a valuable resource for future AI\ndevelopment. In particular, it can give a lot of ideas for our semester\nproject. Furthermore, these guidelines can help early on in the process of\ndesigning future interactions, as they can refine and correct interaction\nmistakes before the implementation of many of these features.<\/p>\n\n\n\n

               Lastly,\nI thought it was amusing the \u201cnewest\u201d member of the team got a shout-out in the\nacknowledgements.<\/p>\n\n\n\n

Questions<\/strong><\/p>\n\n\n\n

  1. The authors bring up trade-offs as being a\ncommon occurrence in balancing these (and past) guidelines. Which of these\nguidelines do you think is easier or harder to bend?<\/li>
  2. The authors ignored the suggestion of their own\npanel of experts in revising one of their guidelines. Do you think this is\nappropriate for this kind of evaluation, and why or why not?<\/li>
  3. Can you think of an example of one of these\nguidelines not being followed in an app you use? What is it, and how could it\nbe improved? <\/li><\/ol>\n","protected":false},"excerpt":{"rendered":"

    Summary                The authors (of which there are many) go over the various HCI-related findings for Human-AI interaction and categorize them into eighteen different types over 4 categories (applicable to when the user encounters the AI assistance). The work makes sure the reader knows it was from the past twenty years of research and from […]<\/p>\n","protected":false},"author":105,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[46,48],"class_list":["post-360","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-class3","tag-hai_guidelines"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/360","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/users\/105"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/comments?post=360"}],"version-history":[{"count":1,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/360\/revisions"}],"predecessor-version":[{"id":361,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/posts\/360\/revisions\/361"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/media?parent=360"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/categories?post=360"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs6724s20\/wp-json\/wp\/v2\/tags?post=360"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}