Publications by authors named "Peter Jan van Leeuwen"

There is a lack of satellite-based aerosol retrievals in the vicinity of low-topped clouds, mainly because reflectance from aerosols is overwhelmed by three-dimensional cloud radiative effects. To account for cloud radiative effects on reflectance observations, we develop a Convolutional Neural Network and retrieve aerosol optical depth (AOD) with 100-500 m horizontal resolution for all cloud-free regions regardless of their distances to clouds. The retrieval uncertainty is 0.

View Article and Find Full Text PDF

Data assimilation (DA) is a powerful tool to optimally combine uncertain model simulations and observations. Among DA techniques, the particle filter (PF) has gained attention for its capacity to deal with nonlinear systems and for its relaxation of the Gaussian assumption. However, the PF may suffer from degeneracy and sample impoverishment.

View Article and Find Full Text PDF

Surface freshening through precipitation can act to stably stratify the upper ocean, forming a rain layer (RL). RLs inhibit subsurface vertical mixing, isolating deeper ocean layers from the atmosphere. This process has been studied using observations and idealized simulations.

View Article and Find Full Text PDF

Hurricane Patricia (2015) over the eastern Pacific was a record-breaking tropical cyclone (TC) under a very favorable environment during its rapid intensification (RI) period, which makes it an optimal real case for studying RI dynamics and predictability. In this study, we performed ensemble Kalman filter analyses at Patricia's early development stage using both traditional observations and the Office of Naval Research Tropical Cyclone Intensity (TCI) field campaign data. It is shown that assimilating the inner-core TCI observations produces a stronger initial vortex and significantly improves the prediction of RI.

View Article and Find Full Text PDF

Many frameworks exist to infer cause and effect relations in complex nonlinear systems, but a complete theory is lacking. A new framework is presented that is fully nonlinear, provides a complete information theoretic disentanglement of causal processes, allows for nonlinear interactions between causes, identifies the causal strength of missing or unknown processes, and can analyze systems that cannot be represented on directed acyclic graphs. The basic building blocks are information theoretic measures such as (conditional) mutual information and a new concept called certainty that monotonically increases with the information available about the target process.

View Article and Find Full Text PDF

A novel particle filter proposed recently, the particle flow filter (PFF), avoids the long-existing weight degeneracy problem in particle filters and, therefore, has great potential to be applied in high-dimensional systems. The PFF adopts the idea of a particle flow, which sequentially pushes the particles from the prior to the posterior distribution, without changing the weight of each particle. The essence of the PFF is that it assumes the particle flow is embedded in a reproducing kernel Hilbert space, so that a practical solution for the particle flow is obtained.

View Article and Find Full Text PDF

Data assimilation is often performed under the perfect model assumption. Although there is an increasing amount of research accounting for model errors in data assimilation, the impact of an incorrect specification of the model errors on the data assimilation results has not been thoroughly assessed. We investigate the effect that an inaccurate time correlation in the model error description can have on data assimilation results, deriving analytical results using a Kalman Smoother for a one-dimensional system.

View Article and Find Full Text PDF

We introduce new parameterizations for autoconversion and accretion rates that greatly improve representation of the growth processes of warm rain. The new parameterizations capitalize on machine-learning and optimization techniques and are constrained by in situ cloud probe measurements from the recent Atmospheric Radiation Measurement Program field campaign at Azores. The uncertainty in the new estimates of autoconversion and accretion rates is about 15% and 5%, respectively, outperforming existing parameterizations.

View Article and Find Full Text PDF

Particle filters contain the promise of fully nonlinear data assimilation. They have been applied in numerous science areas, including the geosciences, but their application to high-dimensional geoscience systems has been limited due to their inefficiency in high-dimensional systems in standard settings. However, huge progress has been made, and this limitation is disappearing fast due to recent developments in proposal densities, the use of ideas from (optimal) transportation, the use of localization and intelligent adaptive resampling strategies.

View Article and Find Full Text PDF

Data assimilation is often performed in a perfect-model scenario, where only errors in initial conditions and observations are considered. Errors in model equations are increasingly being included, but typically using rather adhoc approximations with limited understanding of how these approximations affect the solution and how these approximations interfere with approximations inherent in finite-size ensembles. We provide the first systematic evaluation of the influence of approximations to model errors within a time window of weak-constraint ensemble smoothers.

View Article and Find Full Text PDF

Synchronization based state estimation tries to synchronize a model with the true evolution of a system via the observations. In practice, an extra term is added to the model equations which hampers growth of instabilities transversal to the synchronization manifold. Therefore, there is a very close connection between synchronization and data assimilation.

View Article and Find Full Text PDF

Data assimilation (DA) is used extensively in numerical weather prediction (NWP) to improve forecast skill. Indeed, improvements in forecast skill in NWP models over the past 30 years have directly coincided with improvements in DA schemes. At present, due to data availability and technical challenges, DA is underused in space weather applications, particularly for solar wind prediction.

View Article and Find Full Text PDF