{"id":249,"date":"2018-09-13T03:21:43","date_gmt":"2018-09-13T03:21:43","guid":{"rendered":"https:\/\/wordpress.cs.vt.edu\/cs5984\/?p=249"},"modified":"2018-09-13T03:21:43","modified_gmt":"2018-09-13T03:21:43","slug":"reflection-6-09-13-prerna-juneja","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/cs5984\/2018\/09\/13\/reflection-6-09-13-prerna-juneja\/","title":{"rendered":"Reflection #6 \u2013 [09\/13] \u2013 [Prerna Juneja]"},"content":{"rendered":"

Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms b<\/strong>y <\/strong>Sandvig et al<\/strong><\/p>\n

Measuring Personalization of Web Search by <\/strong>Hannak et al<\/strong><\/p>\n

Summary:<\/strong><\/p>\n

In the first paper authors believe that every algorithm deserves scrutiny as it might be manipulated and discriminatory. They introduce the social scientific audit study used to test for discrimination in housing etc. and propose a similar idea of \u201calgorithm audits\u201d to find out algorithmic bias. They then outline five algorithmic audit designs namely code audit, non-invasive user audit, scraping audit, sock puppet audit and collaborative or crowdsourced audit and discuss the advantages and disadvantages of each. They find the \u2018crowdsourced audit technique\u2019 to be most promising.<\/p>\n

In the second paper, authors study personalization in algorithms using the \u201ccrowdsourced audit\u201d technique described in the first paper. They propose a methodology to measure personalized web results and apply it on 200 mechanical turks and observe that 11.7% of search results show differences due to personalization. Only two factors- being logged in to google account and geographic location leads to measurable personalization. Queries associated with \u2018politics\u2019 and \u2018companies\u2019 were associated with highest personalization.<\/p>\n

Reflection:<\/strong><\/p>\n

Companies have always been altering algorithms to their benefit. Google takes advantage of its market share to promote its services like \u2018google maps\u2019. One will almost never find search results containing URLs to MapQuest, Here WeGo and yahoo news. Market monopoly can be a dangerous thing. It kills competition. Who knows if google starts charging for its free services in the future when we all get used to its products.<\/p>\n

A case of gender discrimination was found in Linked where in response to search for a female contact name you\u2019ll be prompted male versions of that name. Example: \u201cA search for \u201cStephanie Williams brings up a prompt asking if the searcher meant to type \u201cStephen Williams\u201d instead<\/em>.\u201d[1]. While google example shows an intentional bias<\/em> which although is not harming the users directly but is killing the market competition, the linkedin incident seems to be an unintentional bias<\/em> that cropped up in their algorithm since it depended on relative frequencies of words appearing in the queries. So probably \u2018Stephan\u2019 was searched more than \u2018Stephanie\u2019. \u00a0Citing their spokesperson \u201cThe search algorithm is guided by relative frequencies of words appearing in past queries and member profiles, it is not anything to do [with] gender<\/em>.\u201d So authors are right when they say that no algorithm should be considered unbiased.<\/p>\n

Some companies are building Tools to detect bias in their AI algorithms like Facebook (Fairness Flow)[2], Microsoft [3] and Accenture[4]. But the problem is that just like their algorithms these tools will be a black box for us. And we will never know if these companies found bias in their algorithms.<\/p>\n

Privacy vs personalization\/convenience: \u00a0Shouldn\u2019t users have the control over their data. Of what they want to share with the companies? Google was reading our mails for almost a decade for personalised advertisements before it stopped that in 2017 [5]. It still reads them though. It knows about our flight schedules, restaurant reservations. My phone number get distributed to so many retailers, I wonder who is selling them this data<\/p>\n

In the second paper the authors mention that once the user logs in to one of the google services they are automatically logged-in to all. So does that mean my YouTube search affects my Google search?<\/p>\n

According to an article [6] google autocomplete feature is leading to spread of misinformation. The first suggestion that comes up when you type \u201cclimate change is\u201d comes out to be \u201cclimate change is a hoax\u201d. How is misinformation and conspiracy theories ranking up on these platforms?<\/p>\n

Determining bias seems like a very complex problem with online algorithms changing everyday. And there could be multiple dimensions to bias: gender, age, economic status, language, geographical location etc. The collaborative auditing seems to be a good way of collecting data provided it is done systematically and testers are chosen properly. But then again, how many turkers one should hire? Can a few 100 represent the billion population that is using the internet?<\/p>\n

[1] https:\/\/www.seattletimes.com\/business\/microsoft\/how-linkedins-search-engine-may-reflect-a-bias\/<\/a><\/p>\n

[2] https:\/\/qz.com\/1268520\/facebook-says-it-has-a-tool-to-detect-bias-in-its-artificial-intelligence\/<\/a><\/p>\n

[3] https:\/\/www.technologyreview.com\/s\/611138\/microsoft-is-creating-an-oracle-for-catching-biased-ai-algorithms\/<\/a><\/p>\n

[4] https:\/\/techcrunch.com\/2018\/06\/09\/accenture-wants-to-beat-unfair-ai-with-a-professional-toolkit\/<\/a><\/p>\n

[5] https:\/\/variety.com\/2017\/digital\/news\/google-gmail-ads-emails-1202477321\/<\/a><\/p>\n

[6] https:\/\/www.theguardian.com\/technology\/2016\/dec\/16\/google-autocomplete-rightwing-bias-algorithm-political-propaganda<\/p>\n

\u00a0<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms by Sandvig et al Measuring Personalization of Web Search by Hannak et al Summary: In the first paper authors believe that every algorithm deserves scrutiny as it might be manipulated and discriminatory. They introduce the social scientific audit study used to test for discrimination in […]<\/p>\n","protected":false},"author":184,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-249","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/posts\/249","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/users\/184"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/comments?post=249"}],"version-history":[{"count":0,"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/posts\/249\/revisions"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/media?parent=249"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/categories?post=249"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/cs5984\/wp-json\/wp\/v2\/tags?post=249"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}