TapGazer: Text Entry with finger tapping and gaze-directed word selection

Zhenyi He; Christof Lutteroth; Ken Perlin

doi:10.1145/3491102.3501838

TapGazer: Text Entry with finger tapping and gaze-directed word selection

Zhenyi He, Christof Lutteroth, Ken Perlin

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

24 Downloads (Pure)

Abstract

While using VR, efficient text entry is a challenge: users cannot easily locate standard physical keyboards, and keys are often out of reach, e.g. when standing. We present TapGazer, a text entry system where users type by tapping their fingers in place. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. Ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps. We evaluated TapGazer for seated and standing VR: seated novice users using touchpads as tap surfaces reached 44.81 words per minute (WPM), 79.17% of their QWERTY typing speed. Standing novice users tapped on their thighs with touch-sensitive gloves, reaching 45.26 WPM (71.91%). We analyze TapGazer with a theoretical performance model and discuss its potential for text input in future AR scenarios.

Original language	English
Title of host publication	CHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450391573
DOIs	https://doi.org/10.1145/3491102.3501838
Publication status	Published - 29 Apr 2022

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Keywords

Eye Tracking
Input Techniques
Text Entry
Typing
Virtual Reality

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/3491102.3501838

TapGazer__CHI_22_PDF
© ACM, 2022. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, {April 2022} http://doi.acm.org/10.1145/3491102.3501838
Accepted author manuscript, 5.76 MB

Cite this

TapGazer : Text Entry with finger tapping and gaze-directed word selection. / He, Zhenyi; Lutteroth, Christof; Perlin, Ken.

CHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2022. 337 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

@inproceedings{45d3b270c2e84b37bf105a5e9a48e958,

title = "TapGazer: Text Entry with finger tapping and gaze-directed word selection",

abstract = "While using VR, efficient text entry is a challenge: users cannot easily locate standard physical keyboards, and keys are often out of reach, e.g. when standing. We present TapGazer, a text entry system where users type by tapping their fingers in place. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. Ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps. We evaluated TapGazer for seated and standing VR: seated novice users using touchpads as tap surfaces reached 44.81 words per minute (WPM), 79.17% of their QWERTY typing speed. Standing novice users tapped on their thighs with touch-sensitive gloves, reaching 45.26 WPM (71.91%). We analyze TapGazer with a theoretical performance model and discuss its potential for text input in future AR scenarios.",

keywords = "Eye Tracking, Input Techniques, Text Entry, Typing, Virtual Reality",

author = "Zhenyi He and Christof Lutteroth and Ken Perlin",

note = "Funding Information: This research was supported by NSF grant 1626098 and a grant from the Verizon Corporation. We thank all our study participants. ",

year = "2022",

month = apr,

day = "29",

doi = "10.1145/3491102.3501838",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems",

address = "USA United States",

}

TY - GEN

T1 - TapGazer

T2 - Text Entry with finger tapping and gaze-directed word selection

AU - He, Zhenyi

AU - Lutteroth, Christof

AU - Perlin, Ken

N1 - Funding Information: This research was supported by NSF grant 1626098 and a grant from the Verizon Corporation. We thank all our study participants.

PY - 2022/4/29

Y1 - 2022/4/29

N2 - While using VR, efficient text entry is a challenge: users cannot easily locate standard physical keyboards, and keys are often out of reach, e.g. when standing. We present TapGazer, a text entry system where users type by tapping their fingers in place. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. Ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps. We evaluated TapGazer for seated and standing VR: seated novice users using touchpads as tap surfaces reached 44.81 words per minute (WPM), 79.17% of their QWERTY typing speed. Standing novice users tapped on their thighs with touch-sensitive gloves, reaching 45.26 WPM (71.91%). We analyze TapGazer with a theoretical performance model and discuss its potential for text input in future AR scenarios.

AB - While using VR, efficient text entry is a challenge: users cannot easily locate standard physical keyboards, and keys are often out of reach, e.g. when standing. We present TapGazer, a text entry system where users type by tapping their fingers in place. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. Ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps. We evaluated TapGazer for seated and standing VR: seated novice users using touchpads as tap surfaces reached 44.81 words per minute (WPM), 79.17% of their QWERTY typing speed. Standing novice users tapped on their thighs with touch-sensitive gloves, reaching 45.26 WPM (71.91%). We analyze TapGazer with a theoretical performance model and discuss its potential for text input in future AR scenarios.

KW - Eye Tracking

KW - Input Techniques

KW - Text Entry

KW - Typing

KW - Virtual Reality

UR - http://www.scopus.com/inward/record.url?scp=85130540216&partnerID=8YFLogxK

U2 - 10.1145/3491102.3501838

DO - 10.1145/3491102.3501838

M3 - Chapter in a published conference proceeding

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

ER -

TapGazer: Text Entry with finger tapping and gaze-directed word selection

Abstract

Publication series

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this

TapGazer: Text Entry with finger tapping and gaze-directed word selection

Abstract

Publication series

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Projects

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this