Double Deep RL-based strategy for UAV-assisted energy harvesting optimization in disaster-resilient IoT networks

Elmadina, Nahla Nur and Saeed, Rashid A and Saeid, Elsadig and Ali, Elmustafa Sayed and Nafea, Ibtehal and Ahmed, Mayada A and Mokhtar, Rania A and Khalifa, Othman Omran (2024) Double Deep RL-based strategy for UAV-assisted energy harvesting optimization in disaster-resilient IoT networks. In: 9th International Conference on Mechatronics Engineering (ICOM 2024), 13th - 14th August 2024, Kuala Lumpur, Malaysia.

PDF (Full Paper) - Published Version Restricted to Repository staff only Download (1MB) | Request a copy

Abstract

Unmanned Aerial Vehicles (UAVs) are increasingly crucial for emergency-response scenarios, including tasks like wireless power transfer (WPT) and data collection in disaster zones. This paper proposes a Double Deep Reinforcement Learning (DDRL) framework for energy harvesting (EH) in such scenarios. Our framework involves a UAV swarm navigating an area to provide WPT. The primary goal is to enhance service quality in critical areas while enabling dynamic swarm management for tasks like recharging. We formulate this as a nonlinear programming (NLP) optimization problem, maximizing EH from IoT devices and optimizing UAV trajectories under constraints like mission duration and energy limits. Due to the problem's complexity, we propose a lightweight DDRL solution capable of efficiently learning system dynamics. Extensive simulations and comparisons with Deep RL and DDPG algorithms demonstrate the superior performance of DDRL in enhancing EH, covering strategic locations effectively, and achieving high satisfaction and accuracy rates.

Item Type:	Proceeding Paper (Plenary Papers)
Additional Information:	4119/114449
Uncontrolled Keywords:	DDRL, EH, IoT, Energy Consumption, WPT, UAV, Resilient
Subjects:	T Technology > T Technology (General) T Technology > T Technology (General) > T10.5 Communication of technical information T Technology > TK Electrical engineering. Electronics Nuclear engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Electrical and Computer Engineering
Depositing User:	Prof. Dr Othman O. Khalifa
Date Deposited:	17 Sep 2024 14:25
Last Modified:	18 Sep 2024 15:57
URI:	http://irep.iium.edu.my/id/eprint/114449

Actions (login required)

View Item