3D selection with freehand gesture

G. Ren, E. O'Neill

Research output: Contribution to journalArticle

46 Citations (Scopus)

Abstract

The use of 3D computer graphics is important in a very wide range of applications. However, user interaction with 3D applications is still challenging and often does not lend itself to established techniques that have been developed primarily for 2D desktop interaction. Meanwhile, 3D user interfaces that rely on tracking hand-held devices or fiducial markers attached to the user are cumbersome or entirely inappropriate in some situations. These challenges may be addressed by refining and building on the increasing use of freehand gestural input, i.e. without markers or hand-held devices, to extend the fluidity and immediacy of today's 2D touch-based interactions. In this paper, we analyze the characteristics of freehand gestural 3D interaction, and report a set of 3 related evaluation studies focused on the fundamental user interface task of object selection. We found that interaction design requiring a high accuracy single action are not appropriate for freehand gestural selection, while separating it into several connected low demand operations could be a potential solution; that our Reach technique is accurate and potentially useful for option selection tasks with freehand gesture; and that strong directional effects influence performance and usability of both 2D and 3D option selection. We propose guidelines for designers of 3D freehand gestural interaction based on our evaluation results.
Original languageEnglish
Pages (from-to)101-120
Number of pages20
JournalComputers & Graphics
Volume37
Issue number3
DOIs
Publication statusPublished - May 2013

Fingerprint

User interfaces
Fluidity
Computer graphics
Refining

Cite this

3D selection with freehand gesture. / Ren, G.; O'Neill, E.

In: Computers & Graphics, Vol. 37, No. 3, 05.2013, p. 101-120.

Research output: Contribution to journalArticle

Ren, G. ; O'Neill, E. / 3D selection with freehand gesture. In: Computers & Graphics. 2013 ; Vol. 37, No. 3. pp. 101-120.
@article{1551a056d1cb4da985dd042ac132e3c5,
title = "3D selection with freehand gesture",
abstract = "The use of 3D computer graphics is important in a very wide range of applications. However, user interaction with 3D applications is still challenging and often does not lend itself to established techniques that have been developed primarily for 2D desktop interaction. Meanwhile, 3D user interfaces that rely on tracking hand-held devices or fiducial markers attached to the user are cumbersome or entirely inappropriate in some situations. These challenges may be addressed by refining and building on the increasing use of freehand gestural input, i.e. without markers or hand-held devices, to extend the fluidity and immediacy of today's 2D touch-based interactions. In this paper, we analyze the characteristics of freehand gestural 3D interaction, and report a set of 3 related evaluation studies focused on the fundamental user interface task of object selection. We found that interaction design requiring a high accuracy single action are not appropriate for freehand gestural selection, while separating it into several connected low demand operations could be a potential solution; that our Reach technique is accurate and potentially useful for option selection tasks with freehand gesture; and that strong directional effects influence performance and usability of both 2D and 3D option selection. We propose guidelines for designers of 3D freehand gestural interaction based on our evaluation results.",
author = "G. Ren and E. O'Neill",
year = "2013",
month = "5",
doi = "10.1016/j.cag.2012.12.006",
language = "English",
volume = "37",
pages = "101--120",
journal = "Computers & Graphics",
issn = "0097-8493",
publisher = "Elsevier",
number = "3",

}

TY - JOUR

T1 - 3D selection with freehand gesture

AU - Ren, G.

AU - O'Neill, E.

PY - 2013/5

Y1 - 2013/5

N2 - The use of 3D computer graphics is important in a very wide range of applications. However, user interaction with 3D applications is still challenging and often does not lend itself to established techniques that have been developed primarily for 2D desktop interaction. Meanwhile, 3D user interfaces that rely on tracking hand-held devices or fiducial markers attached to the user are cumbersome or entirely inappropriate in some situations. These challenges may be addressed by refining and building on the increasing use of freehand gestural input, i.e. without markers or hand-held devices, to extend the fluidity and immediacy of today's 2D touch-based interactions. In this paper, we analyze the characteristics of freehand gestural 3D interaction, and report a set of 3 related evaluation studies focused on the fundamental user interface task of object selection. We found that interaction design requiring a high accuracy single action are not appropriate for freehand gestural selection, while separating it into several connected low demand operations could be a potential solution; that our Reach technique is accurate and potentially useful for option selection tasks with freehand gesture; and that strong directional effects influence performance and usability of both 2D and 3D option selection. We propose guidelines for designers of 3D freehand gestural interaction based on our evaluation results.

AB - The use of 3D computer graphics is important in a very wide range of applications. However, user interaction with 3D applications is still challenging and often does not lend itself to established techniques that have been developed primarily for 2D desktop interaction. Meanwhile, 3D user interfaces that rely on tracking hand-held devices or fiducial markers attached to the user are cumbersome or entirely inappropriate in some situations. These challenges may be addressed by refining and building on the increasing use of freehand gestural input, i.e. without markers or hand-held devices, to extend the fluidity and immediacy of today's 2D touch-based interactions. In this paper, we analyze the characteristics of freehand gestural 3D interaction, and report a set of 3 related evaluation studies focused on the fundamental user interface task of object selection. We found that interaction design requiring a high accuracy single action are not appropriate for freehand gestural selection, while separating it into several connected low demand operations could be a potential solution; that our Reach technique is accurate and potentially useful for option selection tasks with freehand gesture; and that strong directional effects influence performance and usability of both 2D and 3D option selection. We propose guidelines for designers of 3D freehand gestural interaction based on our evaluation results.

UR - http://www.scopus.com/inward/record.url?scp=84875146398&partnerID=8YFLogxK

UR - http://dx.doi.org/10.1016/j.cag.2012.12.006

U2 - 10.1016/j.cag.2012.12.006

DO - 10.1016/j.cag.2012.12.006

M3 - Article

VL - 37

SP - 101

EP - 120

JO - Computers & Graphics

JF - Computers & Graphics

SN - 0097-8493

IS - 3

ER -