Abstract

Sensing technologies are required to enhance the safety and interaction between humans and robots in the concept of Human-Robot Collaboration (HRC). In this work, a multimodal sensing unit, DiGeTac, composed of two layers with distance, gesture and tactile elements is presented. Distance and gesture elements are placed on the top layer of the DiGeTac, while the tactile element is placed on the bottom layer. The sensing unit DiGeTac and its data acquisition board together are designed as a sensing module. The sensor performance for detection of distance, hand gestures and touch perception are analysed with offline and real-time experiments. The sensing module recognizes hand gestures with 96% accuracy and contact location with 88% accuracy using an Artificial Neural Network (ANN) and a Convolutional Neural Network (CNN), respectively. The sensing capabilities of the proposed module are validated in real-time with a collaborative task using the Universal Robot arm. The sensing capabilities of the proposed DiGeTac, as demonstrated in real-time collaborative tasks with the robot arm, highlight its potential to enhance the interaction in HRC settings by effectively recognizing and responding to human commands.

Original languageEnglish
Article number5501804
Pages (from-to)1-4
Number of pages4
JournalIEEE Sensors Letters
Volume8
Issue number5
Early online date22 Apr 2024
DOIs
Publication statusE-pub ahead of print - 22 Apr 2024

Data Availability Statement

Data created during this research work is openly available from the University of
Bath Research Data Archive at https://doi.org/10.15125/BATH-01388

Keywords

  • Collaboration
  • Contactless gesture interaction
  • Robot sensing systems
  • Robots
  • Safety
  • Sensors
  • Tactile sensors
  • Task analysis
  • human-robot interaction
  • multimodal sensing interface
  • touch-based interaction

ASJC Scopus subject areas

  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'DiGeTac Unit for Multimodal Communication in Human-Robot Interaction'. Together they form a unique fingerprint.

Cite this