The energy-efficient train operation methodology is the focus of this paper, and a Q-Learning-based eco-driving approach is proposed. Firstly, the core idea of energy-distribution-based method (EDBM) that converts the eco-driving problem to the finite Markov decision process is presented. Secondly, Q-Learning approach is proposed to determine the optimal energy distribution policy. Specifically, two different state definitions, i.e., trip-time-relevant (TT) and energy-distribution-relevant (ED) state definitions, are introduced. Finally, the effectiveness of the proposed approach is verified in a deterministic and a stochastic environment. It is also illustrated that TT-state approach takes about 20 times more computation time compared with ED-state approach while the space complexity of TT-state approach is nearly constant. The hyperparameter sensitivity analysis demonstrates the robustness of the proposed approach.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.isatra.2021.04.036DOI Listing

Publication Analysis

Top Keywords

approach
8
q-learning approach
8
approach proposed
8
state definitions
8
proposed approach
8
tt-state approach
8
eco-driving algorithm
4
algorithm trains
4
trains distributing
4
distributing energy
4

Similar Publications

In the fields of engineering, science, technology, and medicine, artificial intelligence (AI) has made significant advancements. In particular, the application of AI techniques in medicine, such as machine learning (ML) and deep learning (DL), is rapidly growing and offers great potential for aiding physicians in the early diagnosis of illnesses. Depression, one of the most prevalent and debilitating mental illnesses, is projected to become the leading cause of disability worldwide by 2040.

View Article and Find Full Text PDF

[Approach to Scabies in Children: An Update].

Acta Med Port

January 2025

Serviço de Dermatologia. Unidade Local de Saúde Santo António. Porto. Portugal.

Scabies is a common dermatological infection that globally affects more than 200 million people. It is caused by the parasite Sarcoptes scabiei var. hominis and its transmission primarily occurs through direct contact.

View Article and Find Full Text PDF

Transformers for Neuroimage Segmentation: Scoping Review.

J Med Internet Res

January 2025

Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates.

Background: Neuroimaging segmentation is increasingly important for diagnosing and planning treatments for neurological diseases. Manual segmentation is time-consuming, apart from being prone to human error and variability. Transformers are a promising deep learning approach for automated medical image segmentation.

View Article and Find Full Text PDF

Background: TheKeep.Ca was built to facilitate engagement with those experiencing cancer in Manitoba, Canada. Constructed between 2020 and 2024 with a group of patient advisors, the website includes information on engagement activities including research participation, the patient advisor role, and how those experiencing cancer can access these Manitoba activities.

View Article and Find Full Text PDF

Biokinetic models can optimise pollutant degradation and enhance microbial growth processes, aiding to protect ecosystem protection. Traditional biokinetic approaches (such as Monod, Haldane, etc.) can be challenging, as they require detailed knowledge of the organism's metabolism and the ability to solve numerous kinetic differential equations based on the principles of micro, molecular biology and biochemistry (first engineering principles) which can lead to discrepancies between predicted and actual degradation rates.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!