Satellite fog computing (SFC) achieves computation, caching, and other functionalities through collaboration among fog nodes. Satellites can provide real-time and reliable satellite-to-ground fusion services by pre-caching content that users may request in advance. However, due to the high-speed mobility of satellites, the complexity of user-access conditions poses a new challenge in selecting optimal caching locations and improving caching efficiency. Motivated by this, in this paper, we propose a real-time caching scheme based on a Double Deep Q-Network (Double DQN). The overarching objective is to enhance the cache hit rate. The simulation results demonstrate that the algorithm proposed in this paper improves the data hit rate by approximately 13% compared to methods without reinforcement learning assistance.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11175040 | PMC |
| http://dx.doi.org/10.3390/s24113370 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
A Green Computing Business Aggregation Strategy for Low Earth Orbit Satellite Networks.
Sensors (Basel)
December 2024
School of Information and Communication, Guilin University of Electronic Technology, 1 Xiamen Road, Guilin 541004, China.
This paper proposes a green computing strategy for low Earth orbit (LEO) satellite networks (LSNs), addressing energy efficiency and delay optimization in dynamic and energy-constrained environments. By integrating a Markov Decision Process (MDP) with a Double Deep Q-Network (Double DQN) and introducing the Energy-Delay Ratio (EDR) metric, this study effectively quantifies and balances energy savings with delay costs. Simulations demonstrate significant energy savings, with reductions of up to 47.
View Article and Find Full Text PDFNoisy Dueling Double Deep Q-Network algorithm for autonomous underwater vehicle path planning.
Front Neurorobot
October 2024
School of Meteorology and Oceanography, National University of Defense Technology, Changsha, Hunan, China.
How to improve the success rate of autonomous underwater vehicle (AUV) path planning and reduce travel time as much as possible is a very challenging and crucial problem in the practical applications of AUV in the complex ocean current environment. Traditional reinforcement learning algorithms lack exploration of the environment, and the strategies learned by the agent may not generalize well to other different environments. To address these challenges, we propose a novel AUV path planning algorithm named the Noisy Dueling Double Deep Q-Network (ND3QN) algorithm by modifying the reward function and introducing a noisy network, which generalizes the traditional D3QN algorithm.
View Article and Find Full Text PDFA Service-Caching Strategy Assisted by Double DQN in LEO Satellite Networks.
Sensors (Basel)
May 2024
School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China.
Satellite fog computing (SFC) achieves computation, caching, and other functionalities through collaboration among fog nodes. Satellites can provide real-time and reliable satellite-to-ground fusion services by pre-caching content that users may request in advance. However, due to the high-speed mobility of satellites, the complexity of user-access conditions poses a new challenge in selecting optimal caching locations and improving caching efficiency.
View Article and Find Full Text PDFImproved Double Deep Q-Network Algorithm Applied to Multi-Dimensional Environment Path Planning of Hexapod Robots.
Sensors (Basel)
March 2024
School of Mechanical and Electrical Engineering, Chengdu University of Technology, Chengdu 610059, China.
Detecting transportation pipeline leakage points within chemical plants is difficult due to complex pathways, multi-dimensional survey points, and highly dynamic scenarios. However, hexapod robots' maneuverability and adaptability make it an ideal candidate for conducting surveys across different planes. The path-planning problem of hexapod robots in multi-dimensional environments is a significant challenge, especially when identifying suitable transition points and planning shorter paths to reach survey points while traversing multi-level environments.
View Article and Find Full Text PDFAn Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning.
Sensors (Basel)
November 2023
School of Computer Science and Engineering, Changchun University of Technology, Changchun 130012, China.
Federated learning (FL) is a distributed machine learning paradigm that enables a large number of clients to collaboratively train models without sharing data. However, when the private dataset between clients is not independent and identically distributed (non-IID), the local training objective is inconsistent with the global training objective, which possibly causes the convergence speed of FL to slow down, or even not converge. In this paper, we design a novel FL framework based on deep reinforcement learning (DRL), named FedRLCS.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!