IEEE Trans Pattern Anal Mach Intell
December 2024
IEEE Trans Pattern Anal Mach Intell
December 2023
In this paper, we propose a novel method for joint recovery of camera pose, object geometry and spatially-varying Bidirectional Reflectance Distribution Function (svBRDF) of 3D scenes that exceed object-scale and hence cannot be captured with stationary light stages. The input are high-resolution RGB-D images captured by a mobile, hand-held capture system with point lights for active illumination. Compared to previous works that jointly estimate geometry and materials from a hand-held scanner, we formulate this problem using a single objective function that can be minimized using off-the-shelf gradient-based solvers.
View Article and Find Full Text PDFWe present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images. Unlike previous specialized architectures for each specific task, we formulate all three tasks as a unified dense correspondence matching problem, which can be solved with a single model by directly comparing feature similarities. Such a formulation calls for discriminative feature representations, which we achieve using a Transformer, in particular the cross-attention mechanism.
View Article and Find Full Text PDFIEEE Trans Pattern Anal Mach Intell
October 2023
Neural fields have revolutionized the area of 3D reconstruction and novel view synthesis of rigid scenes. A key challenge in making such methods applicable to articulated objects, such as the human body, is to model the deformation of 3D locations between the rest pose (a canonical space) and the deformed space. We propose a new articulation module for neural fields, Fast-SNARF, which finds accurate correspondences between canonical space and posed space via iterative root finding.
View Article and Find Full Text PDFIEEE Trans Vis Comput Graph
February 2023
Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we present an efficient framework capable of fast reconstruction, compact modeling, and streamable rendering.
View Article and Find Full Text PDFIEEE Trans Pattern Anal Mach Intell
November 2023
How should we integrate representations from complementary sensors for autonomous driving? Geometry-based fusion has shown promise for perception (e.g., object detection, motion forecasting).
View Article and Find Full Text PDFIEEE Trans Pattern Anal Mach Intell
March 2023
For the last few decades, several major subfields of artificial intelligence including computer vision, graphics, and robotics have progressed largely independently from each other. Recently, however, the community has realized that progress towards robust intelligent systems such as self-driving cars requires a concerted effort across the different fields. This motivated us to develop KITTI-360, successor of the popular KITTI dataset.
View Article and Find Full Text PDFPiezoelectric composites with 3-3 connectivity gathered attraction due to their potential application as an acoustic transducer in medical imaging, non-destructive testing, etc. In this contribution, piezoelectric composites were fabricated with a material extrusion-based additive manufacturing process (MEX), also well-known under the names fused deposition modeling (FDM), fused filament fabrication (FFF) or fused deposition ceramics (FDC). Thermoplastic filaments were used to achieve open and offset printed piezoelectric scaffold structures.
View Article and Find Full Text PDFWe demonstrate instrumentation and methods to enable fluorescence-detected photothermal infrared (F-PTIR) microscopy and then demonstrate the utility of F-PTIR to characterize the composition within phase-separated domains of model amorphous solid dispersions (ASDs) induced by water sorption. In F-PTIR, temperature-dependent changes in fluorescence quantum efficiency are shown to sensitively report on highly localized absorption of mid-infrared radiation. The spatial resolution with which infrared spectroscopy can be performed is dictated by fluorescence microscopy, rather than the infrared wavelength.
View Article and Find Full Text PDFMulti-object tracking (MOT) has been notoriously difficult to evaluate. Previous metrics overemphasize the importance of either detection or association. To address this, we present a novel MOT evaluation metric, higher order tracking accuracy (HOTA), which explicitly balances the effect of performing accurate detection, association and localization into a single unified metric for comparing trackers.
View Article and Find Full Text PDFThis paper addresses the guided depth completion task in which the goal is to predict a dense depth map given a guidance RGB image and sparse depth measurements. Recent advances on this problem nurture hopes that one day we can acquire accurate and dense depth at a very low cost. A major challenge of guided depth completion is to effectively make use of extremely sparse measurements, e.
View Article and Find Full Text PDFFourier transform fluorescence recovery after photobleaching (FT-FRAP) with patterned illumination is theorized and demonstrated for quantitatively evaluating normal and anomalous diffusion. Diffusion characterization is routinely performed to assess mobility in cell biology, pharmacology, and food science. Conventional FRAP is noninvasive, has low sample volume requirements, and can rapidly measure diffusion over distances of a few micrometers.
View Article and Find Full Text PDFSafety workwear often requires antistatic protection to prevent the build-up of static electricity and sparks, which can be extremely dangerous in a working environment. In order to make synthetic antistatic fibers, electrically conducting materials such as carbon black are added to the fiber-forming polymer. This leads to unwanted dark colors in the respective melt-spun fibers.
View Article and Find Full Text PDFStochastic phase transformations within individual crystalline particles were recorded by integration of second harmonic generation (SHG) imaging with differential scanning calorimetry (DSC). The SHG activity of a crystal is highly sensitive to the specific molecular packing arrangement within a noncentrosymmetric lattice, providing access to information otherwise unavailable by conventional imaging approaches. Consequently, lattice transformations associated with dehydration/desolvation events were readily observed by SHG imaging and directly correlated to the phase transformations detected by the DSC measurements.
View Article and Find Full Text PDFAccurate and efficient self-localization is a critical problem for autonomous systems. This paper describes an affordable solution to vehicle self-localization which uses odometry computed from two video cameras and road maps as the sole inputs. The core of the method is a probabilistic model for which an efficient approximate inference algorithm is derived.
View Article and Find Full Text PDFIn this paper, we present a novel probabilistic generative model for multi-object traffic scene understanding from movable platforms which reasons jointly about the 3D scene layout as well as the location and orientation of objects in the scene. In particular, the scene topology, geometry, and traffic activities are inferred from short video sequences. Inspired by the impressive driving capabilities of humans, our model does not rely on GPS, lidar, or map knowledge.
View Article and Find Full Text PDFThe objectives of this study were to measure the occlusal wear of composite resin denture teeth in patients wearing a complete denture and to evaluate factors affecting wear. Fifty participants provided with complete dentures in at least one jaw were included. Gypsum casts were made from preliminary vinyl polysiloxane impressions 4 weeks after insertion, then after 6 (t(1)), 12 (t(2)), and 24 months (t(3)).
View Article and Find Full Text PDF