BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets

Anja Hansen; Sarah Makarem; Kai Kunze; Yexu Zhou; Michael Knierem; Christopher Clarke; Hans Gellersen; Michael Beigl; Tobias Röddiger

doi:10.1145/3715669.3723110

BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets

Anja Hansen, Sarah Makarem, Kai Kunze, Yexu Zhou, Michael Knierem, Christopher Clarke, Hans Gellersen, Michael Beigl, Tobias Röddiger

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

1 Citation (SciVal)

Abstract

Smooth pursuits are natural eye movements that occur when we track a moving target with our gaze. While they were explored as a gaze-based input method using external screens to display moving stimuli, we propose BodyPursuits, a novel HCI method that eliminates additional screens. Stimuli are generated by users tracing smooth trajectories with their hand in mid-air while fixating their gaze on their thumb. We conducted a user study to collect eye-tracking and baseline IMU data from 20 participants performing 10 BodyPursuits gestures. Based on 1800 samples and noise data, we train a TinyHAR classifier. It achieves a macro-average F1 score of 0.772. With UEQ results indicating a positive user experience and RTLX scores showcasing low subjective workload for all 10 gestures, we successfully demonstrated BodyPursuits’ potential as viable interaction method. We envision BodyPursuits could be integrated into EOG earphones to detect mid-air hand gestures without external screens or cameras.

Original language	English
Title of host publication	Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications
Editors	Yusuke Sugano, Mohamed Khamis, Aladine Chetouai, Ludwig Sidenmark, Alessandro Bruno
Pages	1-8
ISBN (Electronic)	9798400714870
DOIs	https://doi.org/10.1145/3715669.3723110
Publication status	Published - 25 May 2025
Event	2025 Symposium on Eye Tracking Research and Applications: ETRA '25 - Toyoko , Japan Duration: 26 May 2025 → 29 May 2025

Publication series

Name	Eye Tracking Research and Applications Symposium (ETRA)

Conference

Conference	2025 Symposium on Eye Tracking Research and Applications
Country/Territory	Japan
City	Toyoko
Period	26/05/25 → 29/05/25

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Funding

This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - GRK2739/1 - Project Nr. 447089431 - Research Training Group: KD2School - Designing Adaptive Systems for Economic Decisions.

Funders	Funder number
Deutsche Forschungsgemeinschaft (DFG)	GRK2739/1, 447089431

Keywords

eye-tracking
gaze input
gaze-gesture combination
human activity recognition
human-computer interaction
inertial measurement unit
midair gestures
smooth pursuits

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Human-Computer Interaction
Ophthalmology
Sensory Systems

Access to Document

10.1145/3715669.3723110

Cite this

Hansen, A., Makarem, S., Kunze, K., Zhou, Y., Knierem, M., Clarke, C., Gellersen, H., Beigl, M., & Röddiger, T. (2025). BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets. In Y. Sugano, M. Khamis, A. Chetouai, L. Sidenmark, & A. Bruno (Eds.), Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications (pp. 1-8). Article 3 (Eye Tracking Research and Applications Symposium (ETRA)). https://doi.org/10.1145/3715669.3723110

BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets. / Hansen, Anja; Makarem, Sarah; Kunze, Kai et al.
Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications. ed. / Yusuke Sugano; Mohamed Khamis; Aladine Chetouai; Ludwig Sidenmark; Alessandro Bruno. 2025. p. 1-8 3 (Eye Tracking Research and Applications Symposium (ETRA)).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Hansen, A, Makarem, S, Kunze, K, Zhou, Y, Knierem, M, Clarke, C, Gellersen, H, Beigl, M & Röddiger, T 2025, BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets. in Y Sugano, M Khamis, A Chetouai, L Sidenmark & A Bruno (eds), Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications., 3, Eye Tracking Research and Applications Symposium (ETRA), pp. 1-8, 2025 Symposium on Eye Tracking Research and Applications, Toyoko , Japan, 26/05/25. https://doi.org/10.1145/3715669.3723110

Hansen A, Makarem S, Kunze K, Zhou Y, Knierem M, Clarke C et al. BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets. In Sugano Y, Khamis M, Chetouai A, Sidenmark L, Bruno A, editors, Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications. 2025. p. 1-8. 3. (Eye Tracking Research and Applications Symposium (ETRA)). doi: 10.1145/3715669.3723110

Hansen, Anja ; Makarem, Sarah ; Kunze, Kai et al. / BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets. Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications. editor / Yusuke Sugano ; Mohamed Khamis ; Aladine Chetouai ; Ludwig Sidenmark ; Alessandro Bruno. 2025. pp. 1-8 (Eye Tracking Research and Applications Symposium (ETRA)).

@inproceedings{615caa67418343d3b0e8485ba4270817,

title = "BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets",

abstract = "Smooth pursuits are natural eye movements that occur when we track a moving target with our gaze. While they were explored as a gaze-based input method using external screens to display moving stimuli, we propose BodyPursuits, a novel HCI method that eliminates additional screens. Stimuli are generated by users tracing smooth trajectories with their hand in mid-air while fixating their gaze on their thumb. We conducted a user study to collect eye-tracking and baseline IMU data from 20 participants performing 10 BodyPursuits gestures. Based on 1800 samples and noise data, we train a TinyHAR classifier. It achieves a macro-average F1 score of 0.772. With UEQ results indicating a positive user experience and RTLX scores showcasing low subjective workload for all 10 gestures, we successfully demonstrated BodyPursuits{\textquoteright} potential as viable interaction method. We envision BodyPursuits could be integrated into EOG earphones to detect mid-air hand gestures without external screens or cameras. ",

keywords = "eye-tracking, gaze input, gaze-gesture combination, human activity recognition, human-computer interaction, inertial measurement unit, midair gestures, smooth pursuits",

author = "Anja Hansen and Sarah Makarem and Kai Kunze and Yexu Zhou and Michael Knierem and Christopher Clarke and Hans Gellersen and Michael Beigl and Tobias R{\"o}ddiger",

note = "Publisher Copyright: {\textcopyright} 2025 Copyright held by the owner/author(s).; 2025 Symposium on Eye Tracking Research and Applications : ETRA '25 ; Conference date: 26-05-2025 Through 29-05-2025",

year = "2025",

month = may,

day = "25",

doi = "10.1145/3715669.3723110",

language = "English",

series = "Eye Tracking Research and Applications Symposium (ETRA)",

pages = "1--8",

editor = "Yusuke Sugano and Mohamed Khamis and Aladine Chetouai and Ludwig Sidenmark and Alessandro Bruno",

booktitle = "Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications",

}

TY - GEN

T1 - BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets

AU - Hansen, Anja

AU - Makarem, Sarah

AU - Kunze, Kai

AU - Zhou, Yexu

AU - Knierem, Michael

AU - Clarke, Christopher

AU - Gellersen, Hans

AU - Beigl, Michael

AU - Röddiger, Tobias

PY - 2025/5/25

Y1 - 2025/5/25

N2 - Smooth pursuits are natural eye movements that occur when we track a moving target with our gaze. While they were explored as a gaze-based input method using external screens to display moving stimuli, we propose BodyPursuits, a novel HCI method that eliminates additional screens. Stimuli are generated by users tracing smooth trajectories with their hand in mid-air while fixating their gaze on their thumb. We conducted a user study to collect eye-tracking and baseline IMU data from 20 participants performing 10 BodyPursuits gestures. Based on 1800 samples and noise data, we train a TinyHAR classifier. It achieves a macro-average F1 score of 0.772. With UEQ results indicating a positive user experience and RTLX scores showcasing low subjective workload for all 10 gestures, we successfully demonstrated BodyPursuits’ potential as viable interaction method. We envision BodyPursuits could be integrated into EOG earphones to detect mid-air hand gestures without external screens or cameras.

AB - Smooth pursuits are natural eye movements that occur when we track a moving target with our gaze. While they were explored as a gaze-based input method using external screens to display moving stimuli, we propose BodyPursuits, a novel HCI method that eliminates additional screens. Stimuli are generated by users tracing smooth trajectories with their hand in mid-air while fixating their gaze on their thumb. We conducted a user study to collect eye-tracking and baseline IMU data from 20 participants performing 10 BodyPursuits gestures. Based on 1800 samples and noise data, we train a TinyHAR classifier. It achieves a macro-average F1 score of 0.772. With UEQ results indicating a positive user experience and RTLX scores showcasing low subjective workload for all 10 gestures, we successfully demonstrated BodyPursuits’ potential as viable interaction method. We envision BodyPursuits could be integrated into EOG earphones to detect mid-air hand gestures without external screens or cameras.

KW - eye-tracking

KW - gaze input

KW - gaze-gesture combination

KW - human activity recognition

KW - human-computer interaction

KW - inertial measurement unit

KW - midair gestures

KW - smooth pursuits

UR - https://www.scopus.com/pages/publications/105008491627

U2 - 10.1145/3715669.3723110

DO - 10.1145/3715669.3723110

M3 - Chapter in a published conference proceeding

T3 - Eye Tracking Research and Applications Symposium (ETRA)

SP - 1

EP - 8

BT - Proceedings, ETRA 2025 - ACM Symposium on Eye Tracking Research and Applications

A2 - Sugano, Yusuke

A2 - Khamis, Mohamed

A2 - Chetouai, Aladine

A2 - Sidenmark, Ludwig

A2 - Bruno, Alessandro

T2 - 2025 Symposium on Eye Tracking Research and Applications

Y2 - 26 May 2025 through 29 May 2025

ER -

BodyPursuits: Exploring Smooth Pursuit Gaze Interaction Based on Body Motion Targets

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this