Jump Markov models and transition state theory: the quasi-stationary distribution approach.

Faraday Discuss

CERMICS, École des Ponts, Université Paris-Est, INRIA, 77455 Champs-sur-Marne, France.

Published: December 2016

AI Article Synopsis

  • The text explores the relationship between metastable continuous state space Markov processes (like the Langevin equations) and discrete jump Markov processes.
  • It emphasizes how quasi-stationary distributions can be used to effectively model exit events from metastable states, aiding in the analysis of accelerated dynamics techniques.
  • Additionally, it discusses how this approach can quantify errors in parameters derived from the Eyring-Kramers formula, providing a theoretical basis for using transition state theory in kinetic modeling.

Article Abstract

We are interested in the connection between a metastable continuous state space Markov process (satisfying e.g. the Langevin or overdamped Langevin equation) and a jump Markov process in a discrete state space. More precisely, we use the notion of quasi-stationary distribution within a metastable state for the continuous state space Markov process to parametrize the exit event from the state. This approach is useful to analyze and justify methods which use the jump Markov process underlying a metastable dynamics as a support to efficiently sample the state-to-state dynamics (accelerated dynamics techniques). Moreover, it is possible by this approach to quantify the error on the exit event when the parametrization of the jump Markov model is based on the Eyring-Kramers formula. This therefore provides a mathematical framework to justify the use of transition state theory and the Eyring-Kramers formula to build kinetic Monte Carlo or Markov state models.

Download full-text PDF

Source
http://dx.doi.org/10.1039/c6fd00120cDOI Listing

Publication Analysis

Top Keywords

jump markov
16
markov process
16
state space
12
state
8
transition state
8
state theory
8
quasi-stationary distribution
8
continuous state
8
space markov
8
exit event
8

Similar Publications

This paper studies the asynchronous output feedback control and H synchronization problems for a class of continuous-time stochastic hidden semi-Markov jump neural networks (SMJNNs) affected by actuator saturation. Initially, a novel neural networks (NNs) model is constructed, incorporating semi-Markov process (SMP), hidden information, and Brownian motion to accurately simulate the complexity and uncertainty of real-world environments. Secondly, acknowledging system mode mismatches and the need for robust anti-interference capabilities, a non-fragile controller based on hidden information is proposed.

View Article and Find Full Text PDF

The spatial and environmental features of regions where clades are evolving are expected to impact biogeographic processes such as speciation, extinction, and dispersal. Any number of regional features (such as elevation, distance, area, etc.) may be directly or indirectly related to these processes.

View Article and Find Full Text PDF

Unified hierarchical relationship between thermodynamic tradeoff relations.

Phys Rev E

October 2024

Department of Physics and Astronomy & Center for Theoretical Physics, Seoul National University, Seoul 08826, Republic of Korea.

Recent years have witnessed a surge of discoveries in the studies of thermodynamic inequalities: the thermodynamic uncertainty relation (TUR) and the entropic bound (EB) provide a lower bound on the entropy production (EP) in terms of nonequilibrium currents; the classical speed limit (CSL) expresses the lower bound on the EP using the geometry of probability distributions; the power-efficiency (PE) tradeoff dictates the maximum power achievable for a heat engine given the level of its thermal efficiency. In this study, we show that there exists a unified hierarchical structure encompassing all of these bounds, with the fundamental inequality given by an extension of the TUR (XTUR) that incorporates the most general range of currentlike and state-dependent observables. By selecting more specific observables, the TUR and the EB follow from the XTUR, and the CSL and the PE tradeoff follow from the EB.

View Article and Find Full Text PDF

Circadian rhythms are endogenous ∼24-hour cycles that significantly influence physiological and behavioral processes. These rhythms are governed by a transcriptional-translational feedback loop of core circadian genes and are essential for maintaining overall health. The study of circadian rhythms has expanded into various omics datasets, necessitating accurate analytical methodology for circadian biomarker detection.

View Article and Find Full Text PDF

This article investigates model-free reinforcement learning (RL)-based H control problem for discrete-time 2-D Markov jump Roesser systems ( 2 -D MJRSs) with optimal disturbance attenuation level. This is compared to existing studies on H control of 2-D MJRSs with optimal disturbance attenuation levels that are off-line and use full system dynamics. We design a comprehensive model-free RL algorithm to solve optimal H control policy, optimize disturbance attenuation level, and search for the initial stabilizing control policy, via online horizontal and vertical data along 2-D MJRSs trajectories.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!