Audio-vision substitution for blind individuals

Addressing Human Information Processing Capacity Limitations

David J. Brown, Michael J. Proulx

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

In this contribution, we consider the factors that influence the information processing capacity of the person using sensory substitution devices, and the influence of how the translated information, here in audio, impacts performance. First, we review aspects of vision substitution by tactile and audio devices, and then we review key theory in human information processing limitations to devise and test use of an audio-vision substitution device, The vOICe, for recognizing visual objects with audio substitution for vision. Participants heard sonifications of two-dimensional (2-D) images and had to match them to alternatives presented either in visual or tactile modalities. To assess whether capacity limits constrain performance, objects were either presented with all information simultaneously (top and bottom as whole objects), or successively (top and bottom of the object one after the other). Performance was superior in the successive trials, indicative of a capacity limit in processing the auditory information. We discuss the implications for training protocols and design to provide a useful accessibility device for blind individuals.

Original languageEnglish
Article number7445819
Pages (from-to)924-931
Number of pages8
JournalIEEE Journal on Selected Topics in Signal Processing
Volume10
Issue number5
DOIs
Publication statusPublished - 1 Aug 2016

Fingerprint

Substitution reactions
Processing

Keywords

  • Assistive Technology
  • Blindness
  • Sensory Substitution
  • Wearable Computers

Cite this

Audio-vision substitution for blind individuals : Addressing Human Information Processing Capacity Limitations. / Brown, David J.; Proulx, Michael J.

In: IEEE Journal on Selected Topics in Signal Processing, Vol. 10, No. 5, 7445819, 01.08.2016, p. 924-931.

Research output: Contribution to journalArticle

@article{ce2799398aa34792b8930a9a9a28d0ac,
title = "Audio-vision substitution for blind individuals: Addressing Human Information Processing Capacity Limitations",
abstract = "In this contribution, we consider the factors that influence the information processing capacity of the person using sensory substitution devices, and the influence of how the translated information, here in audio, impacts performance. First, we review aspects of vision substitution by tactile and audio devices, and then we review key theory in human information processing limitations to devise and test use of an audio-vision substitution device, The vOICe, for recognizing visual objects with audio substitution for vision. Participants heard sonifications of two-dimensional (2-D) images and had to match them to alternatives presented either in visual or tactile modalities. To assess whether capacity limits constrain performance, objects were either presented with all information simultaneously (top and bottom as whole objects), or successively (top and bottom of the object one after the other). Performance was superior in the successive trials, indicative of a capacity limit in processing the auditory information. We discuss the implications for training protocols and design to provide a useful accessibility device for blind individuals.",
keywords = "Assistive Technology, Blindness, Sensory Substitution, Wearable Computers",
author = "Brown, {David J.} and Proulx, {Michael J.}",
year = "2016",
month = "8",
day = "1",
doi = "10.1109/JSTSP.2016.2543678",
language = "English",
volume = "10",
pages = "924--931",
journal = "IEEE Journal on Selected Topics in Signal Processing",
issn = "1932-4553",
publisher = "IEEE",
number = "5",

}

TY - JOUR

T1 - Audio-vision substitution for blind individuals

T2 - Addressing Human Information Processing Capacity Limitations

AU - Brown, David J.

AU - Proulx, Michael J.

PY - 2016/8/1

Y1 - 2016/8/1

N2 - In this contribution, we consider the factors that influence the information processing capacity of the person using sensory substitution devices, and the influence of how the translated information, here in audio, impacts performance. First, we review aspects of vision substitution by tactile and audio devices, and then we review key theory in human information processing limitations to devise and test use of an audio-vision substitution device, The vOICe, for recognizing visual objects with audio substitution for vision. Participants heard sonifications of two-dimensional (2-D) images and had to match them to alternatives presented either in visual or tactile modalities. To assess whether capacity limits constrain performance, objects were either presented with all information simultaneously (top and bottom as whole objects), or successively (top and bottom of the object one after the other). Performance was superior in the successive trials, indicative of a capacity limit in processing the auditory information. We discuss the implications for training protocols and design to provide a useful accessibility device for blind individuals.

AB - In this contribution, we consider the factors that influence the information processing capacity of the person using sensory substitution devices, and the influence of how the translated information, here in audio, impacts performance. First, we review aspects of vision substitution by tactile and audio devices, and then we review key theory in human information processing limitations to devise and test use of an audio-vision substitution device, The vOICe, for recognizing visual objects with audio substitution for vision. Participants heard sonifications of two-dimensional (2-D) images and had to match them to alternatives presented either in visual or tactile modalities. To assess whether capacity limits constrain performance, objects were either presented with all information simultaneously (top and bottom as whole objects), or successively (top and bottom of the object one after the other). Performance was superior in the successive trials, indicative of a capacity limit in processing the auditory information. We discuss the implications for training protocols and design to provide a useful accessibility device for blind individuals.

KW - Assistive Technology

KW - Blindness

KW - Sensory Substitution

KW - Wearable Computers

UR - http://www.scopus.com/inward/record.url?scp=84982720872&partnerID=8YFLogxK

UR - http://dx.doi.org/10.1109/JSTSP.2016.2543678

UR - http://dx.doi.org/10.1109/JSTSP.2016.2543678

U2 - 10.1109/JSTSP.2016.2543678

DO - 10.1109/JSTSP.2016.2543678

M3 - Article

VL - 10

SP - 924

EP - 931

JO - IEEE Journal on Selected Topics in Signal Processing

JF - IEEE Journal on Selected Topics in Signal Processing

SN - 1932-4553

IS - 5

M1 - 7445819

ER -