Integrated energy-water systems for community-level flexibility: A hybrid deep Q-network and multi-objective optimization framework

Peijin Li, Chenghong Gu, Xinyan Cheng, Jiangfeng Li, Mohannad Alhazmi

Research output: Contribution to journalArticlepeer-review

Abstract

As urban populations grow and cities become increasingly complex, the demand for efficient management of energy and water resources in smart cities has never been greater. The challenge lies in integrating diverse and fluctuating energy sources, such as renewable energy, while maintaining sustainability and cost-effectiveness. To address these challenges, this paper presents the Smart Energy-Water Systems (SEWS) framework, which integrates Deep Q-Networks (DQN) and Multi-Objective Evolutionary Algorithm based on Decomposition (MOEA/D) to optimize resource management under conditions of uncertainty and competing objectives. The SEWS framework combines DQN's ability to make dynamic, real-time decisions with MOEA/D's capacity to handle multi-objective optimization. This integration ensures that the system can adjust to changing energy and water demands, while simultaneously minimizing operational costs and maximizing social engagement in peer-to-peer resource trading. Through simulations, we demonstrate that the SEWS framework leads to a 20 % reduction in operational costs and a 30 % increase in community participation in resource trading. These results highlight the potential of SEWS to improve the flexibility, sustainability, and resilience of urban resource systems. The paper provides a promising solution for managing the complex interplay of energy, water, and social factors in the context of smart cities, contributing to the development of more efficient, low-carbon, and inclusive urban environments.

Original languageEnglish
Pages (from-to)4813-4826
Number of pages14
JournalEnergy Reports
Volume13
Early online date22 Apr 2025
DOIs
Publication statusE-pub ahead of print - 22 Apr 2025

Data Availability Statement

Data will be made available on request.

Acknowledgements

The authors would like to acknowledge the support provided by Alexis P. Zhao from Stanford for his invaluable assistance in improving the language and writing quality of this manuscript.

Funding

The authors would like to acknowledge the support provided by Researchers Supporting Project (Project number: RSPD2025R635), King Saud University, Riyadh, Saudi Arabia.

Keywords

  • Deep Q-Networks
  • MOEA/D
  • Peer-to-peer resource trading
  • Smart cities
  • Smart energy-water systems
  • Water-energy nexus

ASJC Scopus subject areas

  • General Energy

Fingerprint

Dive into the research topics of 'Integrated energy-water systems for community-level flexibility: A hybrid deep Q-network and multi-objective optimization framework'. Together they form a unique fingerprint.

Cite this