AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale

Keenon Werling; Janelle Kaneda; Tian Tan; Rishi Agarwal; Six Skov; Tom Van Wouwe; Scott Uhlrich; Nicholas Bianco; Carmichael Ong; Antoine Falisse; Shardul Sapkota; Aidan Chandra; Joshua Carter; Ezio Preatoni; Benjamin Fregly; Jennifer Hicks; Scott Delp; C. Karen Liu

doi:10.1007/978-3-031-73223-2

AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale

Keenon Werling, Janelle Kaneda, Tian Tan, Rishi Agarwal, Six Skov, Tom Van Wouwe, Scott Uhlrich, Nicholas Bianco, Carmichael Ong, Antoine Falisse, Shardul Sapkota, Aidan Chandra, Joshua Carter, Ezio Preatoni, Benjamin Fregly, Jennifer Hicks, Scott Delp, C. Karen Liu

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Abstract

While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of movements. We present the AddBiomechanics Dataset 1.0, which includes physically accurate human dynamics of 273 human subjects, over 70 h of motion and force plate data, totaling more than 24 million frames. To construct this dataset, novel analytical methods were required, which are also reported here. We propose a benchmark for estimating human dynamics from motion using this dataset, and present several baseline results. The AddBiomechanics Dataset is publicly available at addbiomechanics.org/download/_data.html.

Original language	English
Title of host publication	Computer Vision – ECCV 2024
Subtitle of host publication	18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII
Editors	Aleš Leonardis, Elisa Ricci, Stefan Roth, Olga Russakovsky, Torsten Sattler, Gül Varol
Place of Publication	Switzerland
Publisher	Springer Nature Switzerland AG
Pages	490-508
Number of pages	19
ISBN (Electronic)	9783031732232
ISBN (Print)	9783031732225
DOIs	https://doi.org/10.1007/978-3-031-73223-2
Publication status	Published - 4 Oct 2024
Event	18th European Conference on Computer Vision, ECCV 2024 - Milan, Italy Duration: 29 Sept 2024 → 4 Oct 2024

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	15146 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th European Conference on Computer Vision, ECCV 2024
Country/Territory	Italy
City	Milan
Period	29/09/24 → 4/10/24

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

Keywords

benchmark
dataset
human body motion
human body physics
real to sim

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-031-73223-2

https://arxiv.org/abs/2406.18537Licence: CC BY

Cite this

Werling, K., Kaneda, J., Tan, T., Agarwal, R., Skov, S., Van Wouwe, T., Uhlrich, S., Bianco, N., Ong, C., Falisse, A., Sapkota, S., Chandra, A., Carter, J., Preatoni, E., Fregly, B., Hicks, J., Delp, S., & Liu, C. K. (2024). AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale. In A. Leonardis, E. Ricci, S. Roth, O. Russakovsky, T. Sattler, & G. Varol (Eds.), Computer Vision – ECCV 2024 : 18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII (pp. 490-508). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 15146 LNCS). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-031-73223-2

AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale. / Werling, Keenon; Kaneda, Janelle; Tan, Tian et al.
Computer Vision – ECCV 2024 : 18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII. ed. / Aleš Leonardis; Elisa Ricci; Stefan Roth; Olga Russakovsky; Torsten Sattler; Gül Varol. Switzerland: Springer Nature Switzerland AG, 2024. p. 490-508 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 15146 LNCS).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Werling, K, Kaneda, J, Tan, T, Agarwal, R, Skov, S, Van Wouwe, T, Uhlrich, S, Bianco, N, Ong, C, Falisse, A, Sapkota, S, Chandra, A, Carter, J , Preatoni, E, Fregly, B, Hicks, J, Delp, S & Liu, CK 2024, AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale. in A Leonardis, E Ricci, S Roth, O Russakovsky, T Sattler & G Varol (eds), Computer Vision – ECCV 2024 : 18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 15146 LNCS, Springer Nature Switzerland AG, Switzerland, pp. 490-508, 18th European Conference on Computer Vision, ECCV 2024, Milan, Italy, 29/09/24. https://doi.org/10.1007/978-3-031-73223-2

Werling K, Kaneda J, Tan T, Agarwal R, Skov S, Van Wouwe T et al. AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale. In Leonardis A, Ricci E, Roth S, Russakovsky O, Sattler T, Varol G, editors, Computer Vision – ECCV 2024 : 18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII. Switzerland: Springer Nature Switzerland AG. 2024. p. 490-508. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-73223-2

Werling, Keenon ; Kaneda, Janelle ; Tan, Tian et al. / AddBiomechanics Dataset : Capturing the Physics of Human Motion at Scale. Computer Vision – ECCV 2024 : 18th European Conference Milan, Italy, September 29–October 4, 2024 Proceedings, Part LXXXVIII. editor / Aleš Leonardis ; Elisa Ricci ; Stefan Roth ; Olga Russakovsky ; Torsten Sattler ; Gül Varol. Switzerland : Springer Nature Switzerland AG, 2024. pp. 490-508 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{be0a961f9f1448cdbb0de9dea18572d1,

title = "AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale",

abstract = "While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of movements. We present the AddBiomechanics Dataset 1.0, which includes physically accurate human dynamics of 273 human subjects, over 70 h of motion and force plate data, totaling more than 24 million frames. To construct this dataset, novel analytical methods were required, which are also reported here. We propose a benchmark for estimating human dynamics from motion using this dataset, and present several baseline results. The AddBiomechanics Dataset is publicly available at addbiomechanics.org/download/_data.html.",

keywords = "benchmark, dataset, human body motion, human body physics, real to sim",

author = "Keenon Werling and Janelle Kaneda and Tian Tan and Rishi Agarwal and Six Skov and {Van Wouwe}, Tom and Scott Uhlrich and Nicholas Bianco and Carmichael Ong and Antoine Falisse and Shardul Sapkota and Aidan Chandra and Joshua Carter and Ezio Preatoni and Benjamin Fregly and Jennifer Hicks and Scott Delp and Liu, {C. Karen}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.; 18th European Conference on Computer Vision, ECCV 2024 ; Conference date: 29-09-2024 Through 04-10-2024",

year = "2024",

month = oct,

day = "4",

doi = "10.1007/978-3-031-73223-2",

language = "English",

isbn = "9783031732225",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Nature Switzerland AG",

pages = "490--508",

editor = "Ale{\v s} Leonardis and Elisa Ricci and Stefan Roth and Olga Russakovsky and Torsten Sattler and G{\"u}l Varol",

booktitle = "Computer Vision – ECCV 2024",

address = "Switzerland",

}

TY - GEN

T1 - AddBiomechanics Dataset

T2 - 18th European Conference on Computer Vision, ECCV 2024

AU - Werling, Keenon

AU - Kaneda, Janelle

AU - Tan, Tian

AU - Agarwal, Rishi

AU - Skov, Six

AU - Van Wouwe, Tom

AU - Uhlrich, Scott

AU - Bianco, Nicholas

AU - Ong, Carmichael

AU - Falisse, Antoine

AU - Sapkota, Shardul

AU - Chandra, Aidan

AU - Carter, Joshua

AU - Preatoni, Ezio

AU - Fregly, Benjamin

AU - Hicks, Jennifer

AU - Delp, Scott

AU - Liu, C. Karen

PY - 2024/10/4

Y1 - 2024/10/4

N2 - While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of movements. We present the AddBiomechanics Dataset 1.0, which includes physically accurate human dynamics of 273 human subjects, over 70 h of motion and force plate data, totaling more than 24 million frames. To construct this dataset, novel analytical methods were required, which are also reported here. We propose a benchmark for estimating human dynamics from motion using this dataset, and present several baseline results. The AddBiomechanics Dataset is publicly available at addbiomechanics.org/download/_data.html.

AB - While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of movements. We present the AddBiomechanics Dataset 1.0, which includes physically accurate human dynamics of 273 human subjects, over 70 h of motion and force plate data, totaling more than 24 million frames. To construct this dataset, novel analytical methods were required, which are also reported here. We propose a benchmark for estimating human dynamics from motion using this dataset, and present several baseline results. The AddBiomechanics Dataset is publicly available at addbiomechanics.org/download/_data.html.

KW - benchmark

KW - dataset

KW - human body motion

KW - human body physics

KW - real to sim

UR - http://www.scopus.com/inward/record.url?scp=85209554577&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-73223-2

DO - 10.1007/978-3-031-73223-2

M3 - Chapter in a published conference proceeding

AN - SCOPUS:85209554577

SN - 9783031732225

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 490

EP - 508

BT - Computer Vision – ECCV 2024

A2 - Leonardis, Aleš

A2 - Ricci, Elisa

A2 - Roth, Stefan

A2 - Russakovsky, Olga

A2 - Sattler, Torsten

A2 - Varol, Gül

PB - Springer Nature Switzerland AG

CY - Switzerland

Y2 - 29 September 2024 through 4 October 2024

ER -

AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Full Body Kinematics and Ground Reaction Forces of Fifty Heterogeneous Runners Completing Treadmill Running at Various Speeds and Gradients

Cite this

AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Datasets

Full Body Kinematics and Ground Reaction Forces of Fifty Heterogeneous Runners Completing Treadmill Running at Various Speeds and Gradients

Cite this