Roadmap on computational methods in optical imaging and holography [invited].

Unlabelled: Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging.

Miniature color camera via flat hybrid meta-optics.

The race for miniature color cameras using flat meta-optics has rapidly developed the end-to-end design framework using neural networks. Although a large body of work has shown the potential of this methodology, the reported performance is still limited due to fundamental limitations coming from meta-optics, mismatch between simulated and resultant experimental point spread functions, and calibration errors. Here, we use a HIL optics design methodology to solve these limitations and demonstrate a miniature color camera via flat hybrid meta-optics (refractive + meta-mask).

Hybrid diffractive optics design via hardware-in-the-loop methodology for achromatic extended-depth-of-field imaging.

End-to-end optimization of diffractive optical elements (DOEs) profile through a digital differentiable model combined with computational imaging have gained an increasing attention in emerging applications due to the compactness of resultant physical setups. Despite recent works have shown the potential of this methodology to design optics, its performance in physical setups is still limited and affected by manufacturing artefacts of DOE, mismatch between simulated and resultant experimental point spread functions, and calibration errors. Additionally, the computational burden of the digital differentiable model to effectively design the DOE is increasing, thus limiting the size of the DOE that can be designed.

Power-balanced hybrid optics boosted design for achromatic extended depth-of-field imaging via optimized mixed OTF.

A power-balanced hybrid optical imaging system has a diffractive computational camera, introduced in this paper, with image formation by a refractive lens and multilevel phase mask (MPM). This system provides a long focal depth with low chromatic aberrations thanks to MPM and a high energy light concentration due to the refractive lens. We introduce the concept of optical power balance between the lens and MPM, which controls the contribution of each element to modulate the incoming light.

Polarization holographic recording of vortex diffractive optical elements on azopolymer thin films and 3D analysis via phase-shifting digital holographic microscopy.

Direct fabrication of complex diffractive optical elements (DOEs) on photosensitive thin films is of critical importance for the development of advanced optical instruments. In this paper, we design and investigate DOEs capable of generating optical vortices. Analog and digital approaches for one-step polarization holographic recording of vortex DOEs on new carbazole-based azopolymer thin films are described.

Lensless hyperspectral phase imaging in a self-reference setup based on Fourier transform spectroscopy and noise suppression.

A novel phase retrieval algorithm for broadband hyperspectral phase imaging from noisy intensity observations is proposed. It utilizes advantages of the Fourier transform spectroscopy in the self-referencing optical setup and provides additional, beyond spectral intensity distribution, reconstruction of the investigated object's phase. The noise amplification Fellgett's disadvantage is relaxed by the application of a sparse wavefront noise filtering embedded in the proposed algorithm.

Single exposure lensless subpixel phase imaging: optical system design, modelling, and experimental study.

Design and optimization of lensless phase-retrieval optical system with phase modulation of free-space propagation wavefront is proposed for subpixel imaging to achieve super-resolution reconstruction. Contrary to the traditional super-resolution phase-retrieval, the method in this paper requires a single observation only and uses the advanced Super-Resolution Sparse Phase Amplitude Retrieval (SR-SPAR) iterative technique which contains optimized sparsity based filters and multi-scale filters. The successful object imaging relies on modulation of the object wavefront with a random phase-mask, which generates coded diffracted intensity pattern, allowing us to extract subpixel information.

Terahertz pulse time-domain holography with balance detection: complex-domain sparse imaging.

We investigated the peculiarities of the terahertz pulse time-domain holography principle in the case of raster scanning with the balance detection system. The noise in this system represents a Skellam distribution model, which differentiates it from systems based on a photoconductive antenna. We analyzed this Skellam model and provided both numerical and experimental investigations.

[HYBRID OSTEOCHONDRAL TRANSPLANTATION - A NEW METHOD FOR SURGICAL TREATMENT OF OSTEOCHONDRITIS DISSECANS OF THE KNEE JOINT].

Knee osteochondritis desiccans, or Koenig's disease, is commonly found in active young people engaged in manual labor, sports etc., i.e.

Spectral Object Recognition in Hyperspectral Holography with Complex-Domain Denoising.

In this paper, we have applied a recently developed complex-domain hyperspectral denoiser for the object recognition task, which is performed by the correlation analysis of investigated objects' spectra with the fingerprint spectra from the same object. Extensive experiments carried out on noisy data from digital hyperspectral holography demonstrate a significant enhancement of the recognition accuracy of signals masked by noise, when the advanced noise suppression is applied.

Hyperspectral data denoising for terahertz pulse time-domain holography.

We investigated data denoising in hyperspectral terahertz pulse time-domain holography. Using the block-matching algorithms adapted for spatio-temporal and spatio-spectral volumetric data we studied and optimized parameters of these algorithms to improve phase image reconstruction quality. We propose a sequential application of the two algorithms oriented on work in temporal and spectral domains.

Super-resolution microscopy for biological specimens: lensless phase retrieval in noisy conditions.

The paper is devoted to a computational super-resolution microscopy. A complex-valued wavefront of a transparent biological cellular specimen is restored from multiple intensity diffraction patterns registered with noise. For this problem, the recently developed lensless super-resolution phase retrieval algorithm [Optica, 4(7), 786 (2017)] is modified and tuned.

Single Image Super-Resolution Based on Wiener Filter in Similarity Domain.

Single image super-resolution (SISR) is an ill-posed problem aiming at estimating a plausible high-resolution (HR) image from a single low-resolution image. Current state-of-the-art SISR methods are patch-based. They use either external data or internal self-similarity to learn a prior for an HR image.

High-accuracy off-axis wavefront reconstruction from noisy data: local least square with multiple adaptive windows.

A variational algorithm to object wavefront reconstruction from noisy intensity observations is developed for the off-axis holography scenario with imaging in the acquisition plane. The algorithm is based on the local least square technique proposed in paper [J. Opt.

Texture Classification Using Dense Micro-Block Difference.

This paper is devoted to the problem of texture classification. Motivated by recent advancements in the field of compressive sensing and keypoints descriptors, a set of novel features called dense micro-block difference (DMD) is proposed. These features provide highly descriptive representation of image patches by densely capturing the granularities at multiple scales and orientations.

Wavefront reconstruction in digital off-axis holography via sparse coding of amplitude and absolute phase.

This work presents the new method for wavefront reconstruction from a digital hologram recorded in off-axis configuration. The main feature of the proposed algorithm is a good ability for noise filtration due to the original formulation of the problem taking into account the presence of noise in the recorded intensity distribution and the sparse phase and amplitude reconstruction approach with the data-adaptive block-matching 3D technique. Basically, the sparsity assumes that low dimensional models can be used for phase and amplitude approximations.

Nonlocal transform-domain filter for volumetric data denoising and reconstruction.

We present an extension of the BM3D filter to volumetric data. The proposed algorithm, BM4D, implements the grouping and collaborative filtering paradigm, where mutually similar d-dimensional patches are stacked together in a (d+1)-dimensional array and jointly filtered in transform domain. While in BM3D the basic data patches are blocks of pixels, in BM4D we utilize cubes of voxels, which are stacked into a 4-D "group.

Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms.

We propose a powerful video filtering algorithm that exploits temporal and spatial redundancy characterizing natural video sequences. The algorithm implements the paradigm of nonlocal grouping and collaborative filtering, where a higher dimensional transform-domain representation of the observations is leveraged to enforce sparsity, and thus regularize the data: 3-D spatiotemporal volumes are constructed by tracking blocks along trajectories defined by the motion vectors. Mutually similar volumes are then grouped together by stacking them along an additional fourth dimension, thus producing a 4-D structure, termed group, where different types of data correlation exist along the different dimensions: local correlation along the two dimensions of the blocks, temporal correlation along the motion trajectories, and nonlocal spatial correlation (i.

BM3D frames and variational image deblurring.

A family of the block matching 3-D (BM3D) algorithms for various imaging problems has been recently proposed within the framework of nonlocal patchwise image modeling , . In this paper, we construct analysis and synthesis frames, formalizing BM3D image modeling, and use these frames to develop novel iterative deblurring algorithms. We consider two different formulations of the deblurring problem, i.

Absolute phase estimation: adaptive local denoising and global unwrapping.

The paper attacks absolute phase estimation with a two-step approach: the first step applies an adaptive local denoising scheme to the modulo-2 pi noisy phase; the second step applies a robust phase unwrapping algorithm to the denoised modulo-2 pi phase obtained in the first step. The adaptive local modulo-2 pi phase denoising is a new algorithm based on local polynomial approximations. The zero-order and the first-order approximations of the phase are calculated in sliding windows of varying size.

Practical Poissonian-Gaussian noise modeling and fitting for single-image raw-data.

We present a simple and usable noise model for the raw-data of digital imaging sensors. This signal-dependent noise model, which gives the pointwise standard-deviation of the noise as a function of the expectation of the pixel raw-data output, is composed of a Poissonian part, modeling the photon sensing, and Gaussian part, for the remaining stationary disturbances in the output data. We further explicitly take into account the clipping of the data (over- and under-exposure), faithfully reproducing the nonlinear response of the sensor.

Measuring directional coupling between EEG sources.

Directional connectivity in the brain has been typically computed between scalp electroencephalographic (EEG) signals, neglecting the fact that correlations between scalp measurements are partly caused by electrical conduction through the head volume. Although recently proposed techniques are able to identify causality relationships between EEG sources rather than between recording sites, most of them need a priori assumptions about the cerebral regions involved in the EEG generation. We present a novel methodology based on multivariate autoregressive (MVAR) modeling and Independent Component Analysis (ICA) able to determine the temporal activation of the intracerebral EEG sources as well as their approximate locations.

Discrete diffraction transform for propagation, reconstruction, and design of wavefield distributions.

A discrete diffraction transform (DDT) is a novel discrete wavefield propagation model that is aliasing free for a pixelwise invariant object distribution. For this class of distribution, the model is precise and has no typical discretization effects because it corresponds to accurate calculation of the diffraction integral. A spatial light modulator (SLM) is a good example of a system where a pixelwise invariant distribution appears.

Phase local approximation (PhaseLa) technique for phase unwrap from noisy data.

The local polynomial approximation (LPA) is a nonparametric regression technique with pointwise estimation in a sliding window. We apply the LPA of the argument of cos and sin in order to estimate the absolute phase from noisy wrapped phase data. Using the intersection of confidence interval (HCI) algorithm, the window size is selected as adaptive pointwise varying.

Image denoising by sparse 3-D transform-domain collaborative filtering.

We propose a novel image denoising strategy based on an enhanced sparse representation in transform domain. The enhancement of the sparsity is achieved by grouping similar 2-D image fragments (e.g.