{"id":3194,"date":"2023-11-08T15:24:04","date_gmt":"2023-11-08T20:24:04","guid":{"rendered":"https:\/\/wordpress.cs.vt.edu\/3digroup\/?p=3194"},"modified":"2023-11-08T15:27:08","modified_gmt":"2023-11-08T20:27:08","slug":"enabling-ar-vr-task-awareness-via-gaze-history","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/3digroup\/2023\/11\/08\/enabling-ar-vr-task-awareness-via-gaze-history\/","title":{"rendered":"Enabling AR\/VR Task Awareness via Gaze History"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

Using gaze data from a previous study<\/a>, I am leading an exploratory effort to predict a user’s task in VR solely from their gaze data. Preliminary results show that we are able to confidently identify the task in real-time. Future work includes feature engineering to ensure more robust and granular inference of common AR\/VR tasks (or “settings”)<\/a>. <\/p>\n\n\n\n

\"sdfasdfsdfsdfasd\"<\/figure>\n\n\n\n

To further explore the efficacy of our gaze heatmap feature, we employ a few simple machine learning classifiers (K-Nearest Neighbors, Support Vector machine with an RBF kernel, Decision Tree, and Gaussian Naive-Bayes) to predict the task being performed throughout a user trial. The above graph shows promising results regarding task classification in a short period of time. <\/p>\n\n\n\n

<\/p>\n\n\n\n

This work is in preparation for publication.<\/p>\n","protected":false},"excerpt":{"rendered":"

Using gaze data from a previous study, I am leading an exploratory effort to predict a user’s task in VR solely from their gaze data. Preliminary results show that we are able to confidently identify the task in real-time. Future work includes feature engineering to ensure more robust and granular inference of common AR\/VR tasks …<\/a><\/p>\n","protected":false},"author":335,"featured_media":3198,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[530,515,529,528,527,78],"ppma_author":[466,391],"class_list":["post-3194","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects","tag-context-modeling","tag-context-aware","tag-eye-tracking-2","tag-feature-engineering","tag-machine-learning","tag-virtual-reality"],"jetpack_featured_media_url":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2023\/11\/taskAwareness_teaserImage.png","authors":[{"term_id":466,"user_id":335,"is_guest":0,"slug":"ciilo","display_name":"Cory Ilo","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/715e42664b3358101cfe4bb556a94092a52552fe4fa5351e072c24c70bc8252b?s=96&d=mm&r=g","author_category":"","user_url":"https:\/\/www.linkedin.com\/in\/cilo9737\/","last_name":"Ilo","first_name":"Cory","job_title":"","description":"The goal of my research is to build smart interaction techniques and\/or intelligent user interfaces which adapt to the user's total context, e.g. environment, user task, time of day, location, etc. Essentially, the AR system should be able to infer the user's intent to aid interaction or dynamically adjust user interfaces by utilizing the surrounding, inherent context.\r\n\r\nAside from research, my passions include video games, fitness, and traveling. One day, I hope to make open-world AR video games, where your body functions as the controller, a reality!"},{"term_id":391,"user_id":331,"is_guest":0,"slug":"dbowman","display_name":"Doug Bowman","avatar_url":{"url":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2021\/01\/professional_photo2_2019-cropped-square-smaller-scaled.jpg","url2x":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2021\/01\/professional_photo2_2019-cropped-square-smaller-scaled.jpg"},"author_category":"1","user_url":"","last_name":"Bowman","first_name":"Doug","job_title":"","description":"Doug A. Bowman is the Frank J. Maher Professor of Computer Science<\/a> at Virginia Tech<\/a>. He is the principal investigator of the 3D Interaction Group<\/a>, focusing on the topics of three-dimensional user interfaces, VR\/AR user experience, and the benefits of immersion in virtual environments.\r\n\r\nDr. Bowman is one of the co-authors of 3D User Interfaces: Theory and Practice<\/a>. He has served in many roles for the IEEE Virtual Reality Conference<\/a>, including program chair, general chair, and steering committee chair. He also co-founded the IEEE Symposium on 3D User Interfaces (now part of IEEE VR). He received a CAREER award from the National Science Foundation for his work on 3D Interaction, and has been named an ACM Distinguished Scientist. He received the Technical Achievement award from the IEEE Visualization and Graphics Technical Committee in 2014 and the Career Impact Award from IEEE ISMAR in 2021.\r\n\r\nHis undergraduate degree in mathematics and computer science is from Emory University, and he received his M.S. and Ph.D. in computer science from the Georgia Institute of Technology.\r\n\r\nCurriculum vitae (PDF)<\/a>"}],"_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/3194","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/users\/335"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/comments?post=3194"}],"version-history":[{"count":7,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/3194\/revisions"}],"predecessor-version":[{"id":3258,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/3194\/revisions\/3258"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/media\/3198"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/media?parent=3194"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/categories?post=3194"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/tags?post=3194"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/ppma_author?post=3194"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}