A Deep Learning Model with a Self-Attention Mechanism for Leg Joint Angle Estimation across Varied Locomotion Modes

Research output: Contribution to journalArticlepeer-review

4 Citations (SciVal)

Abstract

Conventional trajectory planning for lower limb assistive devices usually relies on a finite-state strategy, which pre-defines fixed trajectory types for specific gait events and activities. The advancement of deep learning enables walking assistive devices to better adapt to varied terrains for diverse users by learning movement patterns from gait data. Using a self-attention mechanism, a temporal deep learning model is developed in this study to continuously generate lower limb joint angle trajectories for an ankle and knee across various activities. Additional analyses, including using Fast Fourier Transform and paired t-tests, are conducted to demonstrate the benefits of the proposed attention model architecture over the existing methods. Transfer learning has also been performed to prove the importance of data diversity. Under a 10-fold leave-one-out testing scheme, the observed attention model errors are 11.50% (±2.37%) and 9.31% (±1.56%) NRMSE for ankle and knee angle estimation, respectively, which are small in comparison to other studies. Statistical analysis using the paired t-test reveals that the proposed attention model appears superior to the baseline model in terms of reduced prediction error. The attention model also produces smoother outputs, which is crucial for safety and comfort. Transfer learning has been shown to effectively reduce model errors and noise, showing the importance of including diverse datasets. The suggested joint angle trajectory generator has the potential to seamlessly switch between different locomotion tasks, thereby mitigating the problem of detecting activity transitions encountered by the traditional finite-state strategy. This data-driven trajectory generation method can also reduce the burden on personalization, as traditional devices rely on prosthetists to experimentally tune many parameters for individuals with diverse gait patterns.

Original languageEnglish
Article number211
Number of pages19
JournalSensors (Switzerland)
Volume24
Issue number1
Early online date29 Dec 2023
DOIs
Publication statusPublished - 1 Jan 2024

Bibliographical note

The dataset analyzed in this study is openly available in FigShare at https://doi.org/10.6084/m9.figshare.5362627.v2 (accessed on 27 December 2023).

Funding

The research was supported by the University of Bath

FundersFunder number
University of Bath

    Keywords

    • attention mechanism
    • prostheses
    • trajectory planning
    • transfer learning
    • transformer

    ASJC Scopus subject areas

    • Analytical Chemistry
    • Information Systems
    • Instrumentation
    • Atomic and Molecular Physics, and Optics
    • Electrical and Electronic Engineering
    • Biochemistry

    Fingerprint

    Dive into the research topics of 'A Deep Learning Model with a Self-Attention Mechanism for Leg Joint Angle Estimation across Varied Locomotion Modes'. Together they form a unique fingerprint.

    Cite this