GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design

Arthur Caetano, Yunhao Luo, Adwait Sharma, Misha Sra

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

Abstract

Grasp User Interfaces (grasp UIs) enable dual-tasking in XR by allowing interaction with digital content while holding physical objects. However, current grasp UI design practices face a fundamental challenge: existing approaches either capture user preferences through labor-intensive elicitation studies that are difficult to scale, or rely on biomechanical models that overlook subjective factors. We introduce GraspR, the first computational model that predicts user preferences for single-finger microgestures in grasp UIs. Our data-driven approach combines the scalability of computational methods with human preference modeling, trained on 1,520 preferences collected via a two-alternative forced choice paradigm across eight participants and four frequently used grasp variations. We demonstrate GraspR's effectiveness through a working prototype that dynamically adjusts interface layouts across four everyday tasks. We release both the dataset and code to support future research in adaptive grasp UIs.

Original languageEnglish
Title of host publicationUIST 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology
EditorsAndrea Bianchi, Elena L. Glassman, Wendy E. Mackay, Shengdong Zhao, Ian Oakley, Jeeeun Kim
Place of PublicationNew York, U. S. A.
PublisherAssociation for Computing Machinery
Pages1-16
Number of pages16
ISBN (Electronic)9798400720376
DOIs
Publication statusPublished - 27 Sept 2025
Event38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025 - Busan, Korea, Republic of
Duration: 28 Sept 20251 Oct 2025

Publication series

NameUIST 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025
Country/TerritoryKorea, Republic of
CityBusan
Period28/09/251/10/25

Acknowledgements

We thank Avinash Nargund for his insightful guidance on rigorous machine-learning evaluation methods. We thank Professor Lixin Yang and Enric Corona for openly sharing the code base and dataset that enabled this work. We thank the U.S. National Science Foundation for supporting this research through the Early CAREER Award 2023 no. 2240133.

Keywords

  • adaptive interfaces
  • extended reality
  • grasp-based interfaces
  • user preference

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design'. Together they form a unique fingerprint.

Cite this