Quantitative 3D Reconstruction from Scanning Electron Microscope Images Based on Affine Camera Models.

Sensors (Basel)

Institute of Measurement and Automatic Control, Faculty of Mechanical Engineering, Leibniz University Hannover, Nienburger Str. 17, 30167 Hannover, Germany.

Published: June 2020

Scanning electron microscopes (SEMs) are versatile imaging devices for the micro- and nanoscale that find application in various disciplines such as the characterization of biological, mineral or mechanical specimen. Even though the specimen's two-dimensional (2D) properties are provided by the acquired images, detailed morphological characterizations require knowledge about the three-dimensional (3D) surface structure. To overcome this limitation, a reconstruction routine is presented that allows the quantitative depth reconstruction from SEM image sequences. Based on the SEM's imaging properties that can be well described by an affine camera, the proposed algorithms rely on the use of affine epipolar geometry, self-calibration via factorization and triangulation from dense correspondences. To yield the highest robustness and accuracy, different sub-models of the affine camera are applied to the SEM images and the obtained results are directly compared to confocal laser scanning microscope (CLSM) measurements to identify the ideal parametrization and underlying algorithms. To solve the rectification problem for stereo-pair images of an affine camera so that dense matching algorithms can be applied, existing approaches are adapted and extended to further enhance the yielded results. The evaluations of this study allow to specify the applicability of the affine camera models to SEM images and what accuracies can be expected for reconstruction routines based on self-calibration and dense matching algorithms.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7349489PMC
http://dx.doi.org/10.3390/s20123598DOI Listing

Publication Analysis

Top Keywords

affine camera
20
scanning electron
8
camera models
8
sem images
8
dense matching
8
matching algorithms
8
affine
6
images
5
camera
5
quantitative reconstruction
4

Similar Publications

Article Synopsis
  • Metric3D v2 is a new geometric foundation model that estimates metric depth and surface normals from single images, crucial for accurate 3D recovery.
  • The model addresses challenges in zero-shot generalization for both normal estimation and depth recovery, with innovative solutions like a camera space transformation module and a joint depth-normal optimization module.
  • Trained on over 16 million images, it outperforms existing methods in multiple benchmarks, offering improved accuracy in recovering 3D structures from diverse internet images.
View Article and Find Full Text PDF

Group-theoretic analysis of symmetry-preserving deployable structures and metamaterials.

Philos Trans A Math Phys Eng Sci

September 2024

Department of Mechanical Engineering, National University of Singapore, Singapore, Singapore.

Many deployable structures in nature, as well as human-made mechanisms, preserve symmetry as their configurations evolve. Examples in nature include blooming flowers, dilation of the iris within the human eye, viral capsid maturation and molecular and bacterial motors. Engineered examples include opening umbrellas, elongating scissor jacks, variable apertures in cameras, expanding Hoberman spheres and some kinds of morphing origami structures.

View Article and Find Full Text PDF

Compressed ultrafast photography (CUP) is a computational imaging technology capable of capturing transient scenes in picosecond scale with a sequence depth of hundreds of frames. Since the inverse problem of CUP is an ill-posed problem, it is challenging to further improve the reconstruction quality under the condition of high noise level and compression ratio. In addition, there are many articles adding an external charge-coupled device (CCD) camera to the CUP system to form the time-unsheared view because the added constraint can improve the reconstruction quality of images.

View Article and Find Full Text PDF

Convolutional neural networks (CNNs) have become instrumental in advancing multi-frame image super-resolution (SR), a technique that merges multiple low-resolution images of the same scene into a high-resolution image. In this paper, a novel deep learning multi-frame SR algorithm is introduced. The proposed CNN model, named Exponential Fusion of Interpolated Frames Network (EFIF-Net), seamlessly integrates fusion and restoration within an end-to-end network.

View Article and Find Full Text PDF

Traditional non-coplanar calibration methods, represented by Tsai's method, are difficult to apply in multi-camera-based stereo vision measurements because of insufficient calibration accuracy, inconvenient operation, etc. Based on projective theory and matrix transformation theory, a novel mathematical model is established to characterize the transformation from targets' 3D affine coordinates to cameras' image coordinates. Then, novel non-coplanar calibration methods for both monocular and binocular camera systems are proposed in this paper.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!