A machine learning decision criterion for reducing scan time for hyperspectral neutron computed tomography systems.

We present the first machine learning-based autonomous hyperspectral neutron computed tomography experiment performed at the Spallation Neutron Source. Hyperspectral neutron computed tomography allows the characterization of samples by enabling the reconstruction of crystallographic information and elemental/isotopic composition of objects relevant to materials science. High quality reconstructions using traditional algorithms such as the filtered back projection require a high signal-to-noise ratio across a wide wavelength range combined with a large number of projections.

High-precision inversion of dynamic radiography using hydrodynamic features.

While radiography is routinely used to probe complex, evolving density fields in research areas ranging from materials science to shock physics to inertial confinement fusion and other national security applications, complications resulting from noise, scatter, complex beam dynamics, etc. prevent current methods of reconstructing density from being accurate enough to identify the underlying physics with sufficient confidence. In this work, we show that using only features that are robustly identifiable in radiographs and combining them with the underlying hydrodynamic equations of motion using a machine learning approach of a conditional generative adversarial network (cGAN) provides a new and effective approach to determine density fields from a dynamic sequence of radiographs.

Physics-based iterative reconstruction for dual-source and flying focal spot computed tomography.

Purpose: For single-source helical Computed Tomography (CT), both Filtered-Back Projection (FBP) and statistical iterative reconstruction have been investigated. However, for dual-source CT with flying focal spot (DS-FFS CT), a statistical iterative reconstruction that accurately models the scanner geometry and acquisition physics remains unknown to researchers. Therefore, our purpose is to present a novel physics-based iterative reconstruction method for DS-FFS CT and assess its image quality.

Multiagent Consensus Equilibrium in Molecular Structure Determination.

Multiagent consensus equilibrium (MACE) is demonstrated for the integration of experimental observables as constraints in molecular structure determination and for the systematic merging of multiple computational architectures. MACE is founded on simultaneously determining the equilibrium point between multiple experimental and/or computational agents; the returned state description (e.g.

Imaging through distributed-volume aberrations using single-shot digital holography.

This paper explores the use of single-shot digital holography data and a novel algorithm, referred to as multiplane iterative reconstruction (MIR), for imaging through distributed-volume aberrations. Such aberrations result in a linear, shift-varying or "anisoplanatic" physical process, where multiple-look angles give rise to different point spread functions within the field of view of the imaging system. The MIR algorithm jointly computes the maximum a posteriori estimates of the anisoplanatic phase errors and the speckle-free object reflectance from the single-shot digital holography data.

MBIR: A cryo-ET 3D reconstruction method that effectively minimizes missing wedge artifacts and restores missing information.

Cryo-Electron Tomography (cryo-ET) has become an essential technique in revealing cellular and macromolecular assembly structures in their native states. However, due to radiation damage and the limited tilt range, cryo-ET suffers from low contrast and missing wedge artifacts, which limits the tomograms to low resolution and hinders further biological interpretation. In this study, we applied the Model-Based Iterative Reconstruction (MBIR) method to obtain tomographic 3D reconstructions of experimental cryo-ET datasets and demonstrated the advantages of MBIR in contrast improvement, missing wedge artifacts reduction, missing information restoration, and subtomogram averaging compared with other reconstruction approaches.

Prior-Guided Metal Artifact Reduction for Iterative X-Ray Computed Tomography.

High-attenuation materials pose significant challenges to computed tomographic imaging. Formed of high mass-density and high atomic number elements, they cause more severe beam hardening and scattering artifacts than do water-like materials. Pre-corrected line-integral density measurements are no longer linearly proportional to the path lengths, leading to reconstructed image suffering from streaking artifacts extending from metal, often along highest-density directions.

Dynamic Sparse Sampling for Confocal Raman Microscopy.

The total number of data points required for image generation in Raman microscopy was greatly reduced using sparse sampling strategies, in which the preceding set of measurements informed the next most information-rich sampling location. Using this approach, chemical images of pharmaceutical materials were obtained with >99% accuracy from 15.8% sampling, representing an ∼6-fold reduction in measurement time relative to full field of view rastering with comparable image quality.

Demonstration of single-shot digital holography using a Bayesian framework.

In this paper, we present experimental results for image reconstruction, with isoplanatic phase-error correction, from single-shot digital holography data. We demonstrate the utility of using a model-based iterative reconstruction (MBIR) algorithm to jointly compute the maximum a posteriori estimates of the phase errors and the real-valued object reflectance function. Specifically, we show that the MBIR algorithm is robust to noise and phase errors over a range of conditions.

Reduced electron exposure for energy-dispersive spectroscopy using dynamic sampling.

Analytical electron microscopy and spectroscopy of biological specimens, polymers, and other beam sensitive materials has been a challenging area due to irradiation damage. There is a pressing need to develop novel imaging and spectroscopic imaging methods that will minimize such sample damage as well as reduce the data acquisition time. The latter is useful for high-throughput analysis of materials structure and chemistry.

Optically coherent image formation and denoising using a plug and play inversion framework.

The performance of optically coherent imaging systems can be limited by measurement and speckle noise. In this paper, we develop an image formation framework for computing the maximum a posteriori estimate of an object's reflectivity when imaged using coherent illumination and detection. The proposed approach allows for the use of Gaussian denoising algorithms (GDAs), without modification, to mitigate the exponentially distributed and signal-dependent noise that occurs in coherent imaging.

Phase-error estimation and image reconstruction from digital-holography data using a Bayesian framework.

The estimation of phase errors from digital-holography data is critical for applications such as imaging or wavefront sensing. Conventional techniques require multiple i.i.

3D reconstruction of the magnetic vector potential using model based iterative reconstruction.

Lorentz transmission electron microscopy (TEM) observations of magnetic nanoparticles contain information on the magnetic and electrostatic potentials. Vector field electron tomography (VFET) can be used to reconstruct electromagnetic potentials of the nanoparticles from their corresponding LTEM images. The VFET approach is based on the conventional filtered back projection approach to tomographic reconstructions and the availability of an incomplete set of measurements due to experimental limitations means that the reconstructed vector fields exhibit significant artifacts.

Second Harmonic Generation Guided Raman Spectroscopy for Sensitive Detection of Polymorph Transitions.

Second harmonic generation (SHG) was integrated with Raman spectroscopy for the analysis of pharmaceutical materials. Particulate formulations of clopidogrel bisulfate were prepared in two crystal forms (Form I and Form II). Image analysis approaches enable automated identification of particles by bright field imaging, followed by classification by SHG.

Synchrotron X-Ray Diffraction Dynamic Sampling for Protein Crystal Centering.

A supervised learning approach for dynamic sampling (SLADS) was developed to reduce X-ray exposure prior to data collection in protein structure determination. Implementation of this algorithm allowed reduction of the X-ray dose to the central core of the crystal by up to 20-fold compared to current raster scanning approaches. This dose reduction corresponds directly to a reduction on X-ray damage to the protein crystals prior to data collection for structure determination.

Dynamic X-ray diffraction sampling for protein crystal positioning.

A sparse supervised learning approach for dynamic sampling (SLADS) is described for dose reduction in diffraction-based protein crystal positioning. Crystal centering is typically a prerequisite for macromolecular diffraction at synchrotron facilities, with X-ray diffraction mapping growing in popularity as a mechanism for localization. In X-ray raster scanning, diffraction is used to identify the crystal positions based on the detection of Bragg-like peaks in the scattering patterns; however, this additional X-ray exposure may result in detectable damage to the crystal prior to data collection.

Modeling and Pre-Treatment of Photon-Starved CT Data for Iterative Reconstruction.

An increasing number of X-ray CT procedures are being conducted with drastically reduced dosage, due at least in part to advances in statistical reconstruction methods that can deal more effectively with noise than can traditional techniques. As data become photon-limited, more detailed models are necessary to deal with count rates that drop to the levels of system electronic noise. We present two options for sinogram pre-treatment that can improve the performance of photon-starved measurements, with the intent of following with model-based image reconstruction.

Multi-channel beam-scanning imaging at kHz frame rates by Lissajous trajectory microscopy.

A beam-scanning microscope based on Lissajous trajectory imaging is described for achieving streaming 2D imaging with continuous frame rates up to 1.4 kHz. The microscope utilizes two fast-scan resonant mirrors to direct the optical beam on a circuitous trajectory through the field of view.

Distributed Signal Decorrelation and Detection in Multi View Camera Networks Using the Vector Sparse Matrix Transform.

This paper introduces the vector sparse matrix transform (vector SMT), a new decorrelating transform suitable for performing distributed processing of high-dimensional signals in sensor networks. We assume that each sensor in the network encodes its measurements into vector outputs instead of scalar ones. The proposed transform decorrelates a sequence of pairs of vector outputs, until these vectors are decorrelated.

High frame-rate multichannel beam-scanning microscopy based on Lissajous trajectories.

A simple beam-scanning optical design based on Lissajous trajectory imaging is described for achieving up to kHz frame-rate optical imaging on multiple simultaneous data acquisition channels. In brief, two fast-scan resonant mirrors direct the optical beam on a circuitous trajectory through the field of view, with the trajectory repeat-time given by the least common multiplier of the mirror periods. Dicing the raw time-domain data into sub-trajectories combined with model-based image reconstruction (MBIR) 3D in-painting algorithms allows for effective frame-rates much higher than the repeat time of the Lissajous trajectory.

Fast space-varying convolution using matrix source coding with applications to camera stray light reduction.

Many imaging applications require the implementation of space-varying convolution for accurate restoration and reconstruction of images. Here, we use the term space-varying convolution to refer to linear operators whose impulse response has slow spatial variation. In addition, these space-varying convolution operators are often dense, so direct implementation of the convolution operator is typically computationally impractical.

Quality and precision of parametric images created from PET sinogram data by direct reconstruction: proof of concept.

We have previously implemented the direct reconstruction of dense kinetic model parameter images ("parametric images") from sinogram data, and compared it to conventional image domain kinetic parameter estimation methods . Although it has been shown that the direct reconstruction algorithm estimates the kinetic model parameters with lower root mean squared error than the conventional image domain techniques, some theoretical obstacles remain. These obstacles include the difficulty of evaluating the accuracy and precision of the estimated parameters.

Model-Based Iterative Reconstruction for Dual-Energy X-Ray CT Using a Joint Quadratic Likelihood Model.

Dual-energy X-ray CT (DECT) has the potential to improve contrast and reduce artifacts as compared to traditional CT. Moreover, by applying model-based iterative reconstruction (MBIR) to dual-energy data, one might also expect to reduce noise and improve resolution. However, the direct implementation of dual-energy MBIR requires the use of a nonlinear forward model, which increases both complexity and computation.