{"id":1099,"date":"2019-02-18T08:00:43","date_gmt":"2019-02-18T08:00:43","guid":{"rendered":"http:\/\/dev.leonardopavanatto.com\/3di\/?p=1099"},"modified":"2020-12-09T20:31:49","modified_gmt":"2020-12-09T20:31:49","slug":"physically-coherent-remote-manipulation-in-vr","status":"publish","type":"post","link":"https:\/\/wordpress.cs.vt.edu\/3digroup\/2019\/02\/18\/physically-coherent-remote-manipulation-in-vr\/","title":{"rendered":"Physically Coherent Remote Manipulation in VR"},"content":{"rendered":"\n<div class=\"wp-block-image\"><figure class=\"alignleft size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2020\/10\/2018-10-03-1_0-e1607204016501.png\" alt=\"\" class=\"wp-image-1101\" width=\"265\" height=\"265\" \/><\/figure><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Much research in computer graphics aims to create physically based motion that is visually plausible\u2014motion that looks correct given our experience with the physical world and understanding of physical laws. It tries to present convincing behaviors of individual entities (e.g., trajectory affected by gravity) and believable interactions between different entities (e.g., collision and deformation). Displaying plausible motion in virtual reality (VR), however, is even more challenging. Unlike animation or traditional video games, VR directly places the user\u2019s body into the virtual environment (VE) as another entity in the physical system. To maintain the overall physical integrity, the interaction between the human body and other virtual entities should also conform to consistent physical laws. Generating such conformity requires not only correct visual information of motion, but also corresponding stimulation both on and inside the human body through somatosensory information. This project proposes the concept of&nbsp;<em>physics coherence<\/em>&nbsp;to describe the level of compliance to physical laws in VR object manipulation<br>&nbsp;We present the design of two techniques to achieve high levels of physics coherence:<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>The first one is physically coherent virtual hand. With this technique, a zero-order mapping between the hand&#8217;s movement and the object&#8217;s movement is simulated using the physics engine, so the control mechanism is similar to a naive simple virtual hand, while physics-based effects are enable (including gravitiy, collision, pseudo-haptic feedback of weight variation by adjusting C\/D ratio).&nbsp;<\/li><li>The second one is called Force Push (T3 in the video), in which expressive hand gestures are used to apply force to the object. Using a novel algorithm that dynamically maps rich features of hand gestures to the properties of the physics simulation, this technique forms a physics-based relationship between visual and kinesthetic cues<em>.<\/em>&nbsp;This is because the amount of force (or torque) applied is determined by the amplitude and speed of gestural input\u2014to move a heavier object by the same distance, the user has to output more force kinesthetically by performing hand gestures with a larger amplitude and faster speed (e.g., pushing harder to translate a heavier object). From a user perception point of view, this can be seen as an attempt to realize pseudo-haptic feedback under this&nbsp;specific control metaphor<\/li><\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">We compared these two with a na\u00efve simple virtual hand technique, measuring a variety of user experience factors. The experimental result provides empirical evidence that physics coherence has a positive influence on hedonic user experience. We summarize our lessons learned from this experiment through design guidelines that emphasize physics-driven motion, physically based mapping between kinesthetic cues and object motion, and relatable metaphors. We also proposed the design of two techniques that illustrate the guidelines, namely the Tennis Ball controller and the Slingshot controller.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"physically_coherent_manipulation\" width=\"1778\" height=\"1000\" src=\"https:\/\/www.youtube.com\/embed\/a-c3VZKpmb8?modestbranding=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n<div class=\"teachpress_pub_list\"><form name=\"tppublistform\" method=\"get\"><a name=\"tppubs\" id=\"tppubs\"><\/a><\/form><div class=\"teachpress_publication_list\"><h3 class=\"tp_h3\" id=\"tp_h3_article\">Journal Articles<\/h3><div class=\"tp_publication tp_publication_article\"><div class=\"tp_pub_info\"><p class=\"tp_pub_author\">Run Yu; Doug A Bowman<\/p><p class=\"tp_pub_title\">Force Push: Exploring Expressive Gesture-to-Force Mappings for Remote Object Manipulation in Virtual Reality <span class=\"tp_pub_type tp_  article\">Journal Article<\/span> <\/p><p class=\"tp_pub_additional\"><span class=\"tp_pub_additional_in\">In: <\/span><span class=\"tp_pub_additional_journal\">Frontiers in ICT, <\/span><span class=\"tp_pub_additional_volume\">vol. 5, <\/span><span class=\"tp_pub_additional_pages\">pp. 25, <\/span><span class=\"tp_pub_additional_year\">2018<\/span>.<\/p><p class=\"tp_pub_menu\"><span class=\"tp_bibtex_link\"><a id=\"tp_bibtex_sh_17\" class=\"tp_show\" onclick=\"teachpress_pub_showhide('17','tp_bibtex')\" title=\"Show BibTeX entry\" style=\"cursor:pointer;\">BibTeX<\/a><\/span><\/p><div class=\"tp_bibtex\" id=\"tp_bibtex_17\" style=\"display:none;\"><div class=\"tp_bibtex_entry\"><pre>@article{283,<br \/>\r\ntitle = {Force Push: Exploring Expressive Gesture-to-Force Mappings for Remote Object Manipulation in Virtual Reality},<br \/>\r\nauthor = {Run Yu and Doug A Bowman},<br \/>\r\nyear  = {2018},<br \/>\r\ndate = {2018-01-01},<br \/>\r\njournal = {Frontiers in ICT},<br \/>\r\nvolume = {5},<br \/>\r\npages = {25},<br \/>\r\nkeywords = {},<br \/>\r\npubstate = {published},<br \/>\r\ntppubtype = {article}<br \/>\r\n}<br \/>\r\n<\/pre><\/div><p class=\"tp_close_menu\"><a class=\"tp_close\" onclick=\"teachpress_pub_showhide('17','tp_bibtex')\">Close<\/a><\/p><\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Much research in computer graphics aims to create physically based motion that is visually plausible\u2014motion that looks correct given our experience with the physical world and understanding of physical laws. It tries to present convincing behaviors of individual entities (e.g., trajectory affected by gravity) and believable interactions between different entities (e.g., collision and deformation). Displaying <a href=\"https:\/\/wordpress.cs.vt.edu\/3digroup\/2019\/02\/18\/physically-coherent-remote-manipulation-in-vr\/\" class=\"more-link\">&#8230;<\/a><\/p>\n","protected":false},"author":331,"featured_media":1101,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[],"ppma_author":[417,391],"class_list":["post-1099","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects"],"jetpack_featured_media_url":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2020\/10\/2018-10-03-1_0-e1607204016501.png","authors":[{"term_id":417,"user_id":0,"is_guest":1,"slug":"run-yu","display_name":"Run Yu","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""},{"term_id":391,"user_id":331,"is_guest":0,"slug":"dbowman","display_name":"Doug Bowman","avatar_url":{"url":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2021\/01\/professional_photo2_2019-cropped-square-smaller-scaled.jpg","url2x":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-content\/uploads\/sites\/141\/2021\/01\/professional_photo2_2019-cropped-square-smaller-scaled.jpg"},"0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/1099","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/users\/331"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/comments?post=1099"}],"version-history":[{"count":3,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/1099\/revisions"}],"predecessor-version":[{"id":2284,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/posts\/1099\/revisions\/2284"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/media\/1101"}],"wp:attachment":[{"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/media?parent=1099"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/categories?post=1099"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/tags?post=1099"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/wordpress.cs.vt.edu\/3digroup\/wp-json\/wp\/v2\/ppma_author?post=1099"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}