rapMenu

Traditional menu designs are not well-suited for command selection on distant displays. We describe a new interaction technique called the “roll-and-pinch menu” (rapMenu), and investigate the design space of remote menu selection using freehand gestural input. The rapMenu maps intuitive hand postures and gestures to a radial menu layout at two levels of granularity: the user rolls her hand to alter the wrist orientation, which makes a group of menu items selectable; then she touches her thumb to a particular finger (forming a pinch gesture) to select a specific item in that group. We present the visual design and behavior of the rapMenu, consider related design issues, examine design variations, and discuss the strengths and limitations of our approach.

The rapMenu maps palm orientation to a group of menu items (as if the user’s hand were rotating around the outside of the radial menu), and pinch gestures (thumb pinches to one of the other fingers) to corresponding items. It affords an intuitive, fast and reliable way to make menu selection with freehand.

@article{3145,

title = {Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures},

author = {Tao Ni and Doug A Bowman and Chris North and Ryan P McMahan},

doi = {10.1016/j.ijhcs.2011.05.001},

issn = {10715819},

year  = {2011},

date = {2011-08-01},

journal = {International Journal of Human-Computer Studies},

volume = {69},

pages = {551 - 562},

keywords = {},

pubstate = {published},

tppubtype = {article}

}

@conference{3928,

title = {Tech-note: rapMenu: Remote Menu Selection using Freehand Gestural Input},

author = {Tao Ni and Ryan P McMahan and Doug A Bowman},

year  = {2008},

date = {2008-01-01},

booktitle = {Proceedings of the IEEE Symposium on 3D User Interfaces},

pages = {55-58},

keywords = {},

pubstate = {published},

tppubtype = {conference}

}