Multi-character Motion Retargeting for Large-Scale Transformations

Maryam Naghizadeh; Darren Cosker

doi:10.1007/978-3-030-22514-8_8

Multi-character Motion Retargeting for Large-Scale Transformations

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

2 Citations (SciVal)

284 Downloads (Pure)

Abstract

Unlike single-character motion retargeting, multi-character motion retargeting (MCMR) algorithms should be able to retarget each character’s motion correcly while maintaining the interaction between them. Existing MCMR solutions mainly focus on small scale changes between interacting characters. However, many retargeting applications require large-scale transformations. In this paper, we propose a new algorithm for large-scale MCMR. We build on the idea of interaction meshes, which are structures representing the spatial relationship among characters. We introduce a new distance-based interaction mesh that embodies the relationship between characters more accurately by prioritizing local connections over global ones. We also introduce a stiffness weight for each skeletal joint in our mesh deformation term, which defines how undesirable it is for the interaction mesh to deform around that joint. This parameter increases the adaptability of our algorithm for large-scale transformations and reduces optimization time considerably. We compare the performance of our algorithm with current state-of-the-art MCMR solution for several motion sequences under four different scenarios. Our results show that our method not only improves the quality of retargeting, but also significantly reduces computation time.

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

Original language	English
Title of host publication	Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings
Subtitle of host publication	Advances in Computer Graphics
Editors	Marina Gavrilova, Jian Chang, Nadia Magnenat Thalmann, Nadia Magnenat Thalmann, Eckhard Hitzer, Hiroshi Ishikawa
Publisher	Springer Verlag
Pages	94-106
Number of pages	13
ISBN (Electronic)	978-3-030-22514-8
ISBN (Print)	978-3-030-22513-1
DOIs	https://doi.org/10.1007/978-3-030-22514-8_8
Publication status	E-pub ahead of print - 12 Jun 2019
Event	36th Computer Graphics International Conference, CGI 2019 - Calgary, Canada Duration: 17 Jun 2019 → 20 Jun 2019

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11542 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	36th Computer Graphics International Conference, CGI 2019
Country/Territory	Canada
City	Calgary
Period	17/06/19 → 20/06/19

Keywords

Character interaction
Computer animation
Joint stiffness
Mesh deformation
Motion retargeting
Space-time optimization

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-030-22514-8_8

Multi-character Motion Retargeting for Large-Scale Transformations.PDF
This is a post-peer-review, pre-copyedit version of a conference article published in CGI 2019: Advances in Computer Graphics. The final authenticated version is available online at: https://doi.org/10.1007/978-3-030-22514-8_8
Accepted author manuscript, 1.29 MB

Cite this

Naghizadeh, M., & Cosker, D. (2019). Multi-character Motion Retargeting for Large-Scale Transformations. In M. Gavrilova, J. Chang, N. M. Thalmann, N. M. Thalmann, E. Hitzer, & H. Ishikawa (Eds.), Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings: Advances in Computer Graphics (pp. 94-106). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11542 LNCS). Springer Verlag. Advance online publication. https://doi.org/10.1007/978-3-030-22514-8_8

Multi-character Motion Retargeting for Large-Scale Transformations. / Naghizadeh, Maryam; Cosker, Darren.
Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings: Advances in Computer Graphics. ed. / Marina Gavrilova; Jian Chang; Nadia Magnenat Thalmann; Nadia Magnenat Thalmann; Eckhard Hitzer; Hiroshi Ishikawa. Springer Verlag, 2019. p. 94-106 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11542 LNCS).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Naghizadeh, M & Cosker, D 2019, Multi-character Motion Retargeting for Large-Scale Transformations. in M Gavrilova, J Chang, NM Thalmann, NM Thalmann, E Hitzer & H Ishikawa (eds), Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings: Advances in Computer Graphics. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11542 LNCS, Springer Verlag, pp. 94-106, 36th Computer Graphics International Conference, CGI 2019, Calgary, Canada, 17/06/19. https://doi.org/10.1007/978-3-030-22514-8_8

Naghizadeh M, Cosker D. Multi-character Motion Retargeting for Large-Scale Transformations. In Gavrilova M, Chang J, Thalmann NM, Thalmann NM, Hitzer E, Ishikawa H, editors, Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings: Advances in Computer Graphics. Springer Verlag. 2019. p. 94-106. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2019 Jun 12. doi: 10.1007/978-3-030-22514-8_8

Naghizadeh, Maryam ; Cosker, Darren. / Multi-character Motion Retargeting for Large-Scale Transformations. Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings: Advances in Computer Graphics. editor / Marina Gavrilova ; Jian Chang ; Nadia Magnenat Thalmann ; Nadia Magnenat Thalmann ; Eckhard Hitzer ; Hiroshi Ishikawa. Springer Verlag, 2019. pp. 94-106 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b6c35e93726644378a5c75df31f5e6c6,

title = "Multi-character Motion Retargeting for Large-Scale Transformations",

abstract = "Unlike single-character motion retargeting, multi-character motion retargeting (MCMR) algorithms should be able to retarget each character{\textquoteright}s motion correcly while maintaining the interaction between them. Existing MCMR solutions mainly focus on small scale changes between interacting characters. However, many retargeting applications require large-scale transformations. In this paper, we propose a new algorithm for large-scale MCMR. We build on the idea of interaction meshes, which are structures representing the spatial relationship among characters. We introduce a new distance-based interaction mesh that embodies the relationship between characters more accurately by prioritizing local connections over global ones. We also introduce a stiffness weight for each skeletal joint in our mesh deformation term, which defines how undesirable it is for the interaction mesh to deform around that joint. This parameter increases the adaptability of our algorithm for large-scale transformations and reduces optimization time considerably. We compare the performance of our algorithm with current state-of-the-art MCMR solution for several motion sequences under four different scenarios. Our results show that our method not only improves the quality of retargeting, but also significantly reduces computation time.This project has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation programme under the Marie Sk{\l}odowska-Curie grant agreement No 665992 ",

keywords = "Character interaction, Computer animation, Joint stiffness, Mesh deformation, Motion retargeting, Space-time optimization",

author = "Maryam Naghizadeh and Darren Cosker",

year = "2019",

month = jun,

day = "12",

doi = "10.1007/978-3-030-22514-8_8",

language = "English",

isbn = "978-3-030-22513-1",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "94--106",

editor = "Marina Gavrilova and Jian Chang and Thalmann, {Nadia Magnenat} and Thalmann, {Nadia Magnenat} and Eckhard Hitzer and Hiroshi Ishikawa",

booktitle = "Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings",

note = "36th Computer Graphics International Conference, CGI 2019 ; Conference date: 17-06-2019 Through 20-06-2019",

}

TY - GEN

T1 - Multi-character Motion Retargeting for Large-Scale Transformations

AU - Naghizadeh, Maryam

AU - Cosker, Darren

PY - 2019/6/12

Y1 - 2019/6/12

N2 - Unlike single-character motion retargeting, multi-character motion retargeting (MCMR) algorithms should be able to retarget each character’s motion correcly while maintaining the interaction between them. Existing MCMR solutions mainly focus on small scale changes between interacting characters. However, many retargeting applications require large-scale transformations. In this paper, we propose a new algorithm for large-scale MCMR. We build on the idea of interaction meshes, which are structures representing the spatial relationship among characters. We introduce a new distance-based interaction mesh that embodies the relationship between characters more accurately by prioritizing local connections over global ones. We also introduce a stiffness weight for each skeletal joint in our mesh deformation term, which defines how undesirable it is for the interaction mesh to deform around that joint. This parameter increases the adaptability of our algorithm for large-scale transformations and reduces optimization time considerably. We compare the performance of our algorithm with current state-of-the-art MCMR solution for several motion sequences under four different scenarios. Our results show that our method not only improves the quality of retargeting, but also significantly reduces computation time.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

AB - Unlike single-character motion retargeting, multi-character motion retargeting (MCMR) algorithms should be able to retarget each character’s motion correcly while maintaining the interaction between them. Existing MCMR solutions mainly focus on small scale changes between interacting characters. However, many retargeting applications require large-scale transformations. In this paper, we propose a new algorithm for large-scale MCMR. We build on the idea of interaction meshes, which are structures representing the spatial relationship among characters. We introduce a new distance-based interaction mesh that embodies the relationship between characters more accurately by prioritizing local connections over global ones. We also introduce a stiffness weight for each skeletal joint in our mesh deformation term, which defines how undesirable it is for the interaction mesh to deform around that joint. This parameter increases the adaptability of our algorithm for large-scale transformations and reduces optimization time considerably. We compare the performance of our algorithm with current state-of-the-art MCMR solution for several motion sequences under four different scenarios. Our results show that our method not only improves the quality of retargeting, but also significantly reduces computation time.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

KW - Character interaction

KW - Computer animation

KW - Joint stiffness

KW - Mesh deformation

KW - Motion retargeting

KW - Space-time optimization

UR - http://www.scopus.com/inward/record.url?scp=85067700229&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22514-8_8

DO - 10.1007/978-3-030-22514-8_8

M3 - Chapter in a published conference proceeding

AN - SCOPUS:85067700229

SN - 978-3-030-22513-1

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 94

EP - 106

BT - Advances in Computer Graphics - 36th Computer Graphics International Conference, CGI 2019, Proceedings

A2 - Gavrilova, Marina

A2 - Chang, Jian

A2 - Thalmann, Nadia Magnenat

A2 - Hitzer, Eckhard

A2 - Ishikawa, Hiroshi

PB - Springer Verlag

T2 - 36th Computer Graphics International Conference, CGI 2019

Y2 - 17 June 2019 through 20 June 2019

ER -

Multi-character Motion Retargeting for Large-Scale Transformations

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this

Multi-character Motion Retargeting for Large-Scale Transformations

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Projects

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this