RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality

Dominic Potts; Miloni Gada; Aastha Gupta; Kavya Goel; Klaus Philipp Krzok; Genevieve Pate; Joe Hartley; Mark Weston-Arnold; Jakob  Aylott; Christopher Clarke; Crescent Jicol; Christof Lutteroth

doi:10.1145/3706598.3713957

RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality

Dominic Potts, Miloni Gada, Aastha Gupta, Kavya Goel, Klaus Philipp Krzok, Genevieve Pate, Joe Hartley, Mark Weston-Arnold, Jakob Aylott, Christopher Clarke, Crescent Jicol, Christof Lutteroth

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Abstract

Virtual Reality (VR) designers and researchers often need to measure emotions and presence as they evolve over time. The experience sampling method (ESM) is a common way to achieve this, however, ESM disrupts the experience and lacks granularity. We propose RetroSketch, a new method for measuring subjective emotions and presence in VR, where users watch back their VR experience and retrospectively sketch a plot of their feelings. RetroSketch leaves the VR experience undisturbed and yields highly granular data, including information about salient events and qualitative descriptions of their feelings. We compared RetroSketch and ESM in a large study (n=140) using five different VR experiences over one-hour sessions. Our results show that RetroSketch and ESM measures are highly correlated with each other, as well as physiological measures indicative of emotion. The correlations are robust across different VR experiences and user demographics. They also highlight the impact of ESM on users’ experience.

Original language	English
Title of host publication	CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Place of Publication	New York, U. S. A.
Publisher	Association for Computing Machinery
Pages	1-25
ISBN (Electronic)	9798400713941
ISBN (Print)	9798400713941
DOIs	https://doi.org/10.1145/3706598.3713957
Publication status	Published - 26 Apr 2025

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Data Availability Statement

[...] we make the following contributions: [...] A large open dataset of emotions, presence, and ten physiological measures across five VR experiences (n=140), see [172].

[172] Dominic Potts, Miloni Gada, Aastha Gupta, Kavya Goel, Klaus Phillip Krzok, Genieve Pate, Joseph Hartley, Mark Weston-Arnold, Jakob Aylott, Christopher Clarke, Crescent Jicol, and Christof Lutteroth. 2025. Dataset for "RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality". Bath: University of Bath Research Data Archive. https://doi.org/10.15125/BATH-01489

Acknowledgements

We would like to acknowledge Jovana Cuxac, Jasmine Chung, Katherine Baldrian, and Tarini Sehgal for their support and assistance in conducting the study.

Funding

We would like to acknowledge Jovana Cuxac, Jasmine Chung, Katherine Baldrian, and Tarini Sehgal for their support and assistance in conducting the study. This work is supported by the European Union's Horizon Europe research and innovation program and Innovate UK under grant agreement No 101070533, project EMIL (The European Media and Immersion Lab: https://emil-xr.eu/), as well as the Royal Society Industry Fellowship under grant agreement No INF\\R1\\221058.

Funders	Funder number
European Union's Horizon Europe research and innovation program
Jovana Cuxac
Jasmine Chung
Katherine Baldrian
Innovate UK	101070533
Royal Society	INF\R1\221058

Keywords

emotion
emotion appraisal
emotion measurement
experience sampling
games
physiological correlates
physiological sensing
presence
presence measurement
virtual reality

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/3706598.3713957Licence: CC BY

Cite this

Potts, D., Gada, M., Gupta, A., Goel, K., Krzok, K. P., Pate, G., Hartley, J., Weston-Arnold, M., Aylott, J., Clarke, C., Jicol, C., & Lutteroth, C. (2025). RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality. In CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (pp. 1-25). Article 463 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3706598.3713957

RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality. / Potts, Dominic; Gada, Miloni; Gupta, Aastha et al.
CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. New York, U. S. A.: Association for Computing Machinery, 2025. p. 1-25 463 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Potts, D, Gada, M, Gupta, A, Goel, K, Krzok, KP, Pate, G, Hartley, J, Weston-Arnold, M, Aylott, J, Clarke, C , Jicol, C & Lutteroth, C 2025, RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality. in CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems., 463, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, New York, U. S. A., pp. 1-25. https://doi.org/10.1145/3706598.3713957

Potts D, Gada M, Gupta A, Goel K, Krzok KP, Pate G et al. RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality. In CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. New York, U. S. A.: Association for Computing Machinery. 2025. p. 1-25. 463. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3706598.3713957

Potts, Dominic ; Gada, Miloni ; Gupta, Aastha et al. / RetroSketch : A Retrospective Method for Measuring Emotions and Presence in Virtual Reality. CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. New York, U. S. A. : Association for Computing Machinery, 2025. pp. 1-25 (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{a6f8a1b551974a418ade8508cd519f6c,

title = "RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality",

abstract = "Virtual Reality (VR) designers and researchers often need to measure emotions and presence as they evolve over time. The experience sampling method (ESM) is a common way to achieve this, however, ESM disrupts the experience and lacks granularity. We propose RetroSketch, a new method for measuring subjective emotions and presence in VR, where users watch back their VR experience and retrospectively sketch a plot of their feelings. RetroSketch leaves the VR experience undisturbed and yields highly granular data, including information about salient events and qualitative descriptions of their feelings. We compared RetroSketch and ESM in a large study (n=140) using five different VR experiences over one-hour sessions. Our results show that RetroSketch and ESM measures are highly correlated with each other, as well as physiological measures indicative of emotion. The correlations are robust across different VR experiences and user demographics. They also highlight the impact of ESM on users{\textquoteright} experience.",

keywords = "emotion, emotion appraisal, emotion measurement, experience sampling, games, physiological correlates, physiological sensing, presence, presence measurement, virtual reality",

author = "Dominic Potts and Miloni Gada and Aastha Gupta and Kavya Goel and Krzok, \{Klaus Philipp\} and Genevieve Pate and Joe Hartley and Mark Weston-Arnold and Jakob Aylott and Christopher Clarke and Crescent Jicol and Christof Lutteroth",

note = "Publisher Copyright: {\textcopyright} 2025 Copyright held by the owner/author(s).",

year = "2025",

month = apr,

day = "26",

doi = "10.1145/3706598.3713957",

language = "English",

isbn = "9798400713941",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

pages = "1--25",

booktitle = "CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems",

address = "USA United States",

}

TY - GEN

T1 - RetroSketch

T2 - A Retrospective Method for Measuring Emotions and Presence in Virtual Reality

AU - Potts, Dominic

AU - Gada, Miloni

AU - Gupta, Aastha

AU - Goel, Kavya

AU - Krzok, Klaus Philipp

AU - Pate, Genevieve

AU - Hartley, Joe

AU - Weston-Arnold, Mark

AU - Aylott, Jakob

AU - Clarke, Christopher

AU - Jicol, Crescent

AU - Lutteroth, Christof

PY - 2025/4/26

Y1 - 2025/4/26

N2 - Virtual Reality (VR) designers and researchers often need to measure emotions and presence as they evolve over time. The experience sampling method (ESM) is a common way to achieve this, however, ESM disrupts the experience and lacks granularity. We propose RetroSketch, a new method for measuring subjective emotions and presence in VR, where users watch back their VR experience and retrospectively sketch a plot of their feelings. RetroSketch leaves the VR experience undisturbed and yields highly granular data, including information about salient events and qualitative descriptions of their feelings. We compared RetroSketch and ESM in a large study (n=140) using five different VR experiences over one-hour sessions. Our results show that RetroSketch and ESM measures are highly correlated with each other, as well as physiological measures indicative of emotion. The correlations are robust across different VR experiences and user demographics. They also highlight the impact of ESM on users’ experience.

AB - Virtual Reality (VR) designers and researchers often need to measure emotions and presence as they evolve over time. The experience sampling method (ESM) is a common way to achieve this, however, ESM disrupts the experience and lacks granularity. We propose RetroSketch, a new method for measuring subjective emotions and presence in VR, where users watch back their VR experience and retrospectively sketch a plot of their feelings. RetroSketch leaves the VR experience undisturbed and yields highly granular data, including information about salient events and qualitative descriptions of their feelings. We compared RetroSketch and ESM in a large study (n=140) using five different VR experiences over one-hour sessions. Our results show that RetroSketch and ESM measures are highly correlated with each other, as well as physiological measures indicative of emotion. The correlations are robust across different VR experiences and user demographics. They also highlight the impact of ESM on users’ experience.

KW - emotion

KW - emotion appraisal

KW - emotion measurement

KW - experience sampling

KW - games

KW - physiological correlates

KW - physiological sensing

KW - presence

KW - presence measurement

KW - virtual reality

UR - https://revealcentre.org/projects/retrosketch-a-retrospective-method-for-measuring-emotions-and-presence-in-virtual-reality/

UR - http://www.scopus.com/inward/record.url?scp=105005766151&partnerID=8YFLogxK

U2 - 10.1145/3706598.3713957

DO - 10.1145/3706598.3713957

M3 - Chapter in a published conference proceeding

SN - 9798400713941

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 1

EP - 25

BT - CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

CY - New York, U. S. A.

ER -

RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality

Abstract

Publication series

Bibliographical note

Data Availability Statement

Acknowledgements

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Dataset for "RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality"

Cite this

RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality

Abstract

Publication series

Bibliographical note

Data Availability Statement

Acknowledgements

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Datasets

Dataset for "RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual Reality"

Cite this