SubmergeStyleGAN: Synthetic Underwater Data Generation with Style Transfer for Domain Adaptation

Mohamed E. Fathy, Samer A. Ahmed, Mohammed I. Awad, Hossam E. Abd El Munim

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

2 Citations (SciVal)
103 Downloads (Pure)

Abstract

Underwater computer vision applications are challenged by limited access to annotated underwater datasets. Additionally, convolutional neural networks (CNNs) trained on in-air datasets do not perform well underwater due to the high domain variance caused by the degradation impact of the water column. This paper proposes an air-to-water dataset generator to create visually plausible underwater scenes out of existing in-air datasets. SubmergeStyleGAN, a generative adversarial network (GAN) designed to model attenuation, backscattering, and absorption, utilizes depth maps to apply range-dependent attenuation style transfer. In this work, the generated attenuated images and their corresponding original pairs are used to train an underwater image enhancement CNN. Real underwater datasets were used to validate the proposed approach by assessing various image quality metrics, including UCIQE, UIQM and CCF, as well as disparity estimation accuracy before and after enhancement. SubmergeStyleGAN exhibits a faster and more robust training procedure compared to existing methods in the literature.
Original languageEnglish
Title of host publication2023 International Conference on Digital Image Computing
Subtitle of host publicationTechniques and Applications, DICTA 2023
Place of PublicationU. S. A.
PublisherIEEE
Pages546-553
Number of pages8
ISBN (Electronic)9798350382204
ISBN (Print)9798350382211
DOIs
Publication statusPublished - 29 Jan 2024
EventThe International Conference on
Digital Image Computing: Techniques and Applications
- Port Macquarie NSW Australia, Port Macquarie, Australia
Duration: 28 Nov 20231 Dec 2023
https://www.dictaconference.org/

Publication series

Name2023 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2023

Conference

ConferenceThe International Conference on
Digital Image Computing: Techniques and Applications
Abbreviated titleDICTA
Country/TerritoryAustralia
CityPort Macquarie
Period28/11/231/12/23
Internet address

Funding

No funding acknowledged.

Keywords

  • Deep Learning
  • Generative Adversarial Network
  • Image Enhancement
  • Style Transfer
  • Underwater Perception

ASJC Scopus subject areas

  • Artificial Intelligence
  • Signal Processing
  • Radiology Nuclear Medicine and imaging
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'SubmergeStyleGAN: Synthetic Underwater Data Generation with Style Transfer for Domain Adaptation'. Together they form a unique fingerprint.

Cite this