IEEE Trans Pattern Anal Mach Intell
December 2023
This paper presents a new text-guided 3D shape generation approach DreamStone that uses images as a stepping stone to bridge the gap between the text and shape modalities for generating 3D shapes without requiring paired text and 3D data. The core of our approach is a two-stage feature-space alignment strategy that leverages a pre-trained single-view reconstruction (SVR) model to map CLIP features to shapes: to begin with, map the CLIP image feature to the detail-rich 3D shape space of the SVR model, then map the CLIP text feature to the 3D shape space through encouraging the CLIP-consistency between the rendered images and the input text. Besides, to extend beyond the generative capability of the SVR model, we design the text-guided 3D shape stylization module that can enhance the output shapes with novel structures and textures.
View Article and Find Full Text PDFColonoscopy, as the golden standard for screening colon cancer and diseases, offers considerable benefits to patients. However, it also imposes challenges on diagnosis and potential surgery due to the narrow observation perspective and limited perception dimension. Dense depth estimation can overcome the above limitations and offer doctors straightforward 3D visual feedback.
View Article and Find Full Text PDFIEEE Trans Neural Netw Learn Syst
May 2022
The performance of existing sign language recognition approaches is typically limited by the scale of training data. To address this issue, we propose a mutual enhancement network (MEN) for joint sign language recognition and education. First, a sign language recognition system built upon a spatial-temporal network is proposed to recognize the semantic category of a given sign language video.
View Article and Find Full Text PDFIEEE Trans Pattern Anal Mach Intell
February 2022
In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures the geometric relationships between depth and surface normals with the proposed depth-to-normal and normal-to-depth modules. In particular, the "depth-to-normal" module exploits the least square solution of estimating surface normals from depth to improve their quality, while the "normal-to-depth" module refines the depth map based on the constraints on surface normals through kernel regression.
View Article and Find Full Text PDFThis work evaluates the characteristics of short-term release of volatile and semi-volatile organic chemicals from clothing fabrics that are exposed to environmental tobacco smoke (ETS). Various fabrics were concurrently exposed to ETS in a controlled facility, and the chemicals off-gassed were sampled using solid phase micro-extraction coupled with GC/MS analysis. Toluene-reference concentration (TRC) was calculated for nine selected chemicals and compared.
View Article and Find Full Text PDF