Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this article, we present a novel cost volume construction method, named attention concatenation volume (ACV), which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume. The ACV can be seamlessly embedded into most stereo matching networks, the resulting networks can use a more lightweight aggregation network and meanwhile achieve higher accuracy. We further design a fast version of ACV to enable real-time performance, named Fast-ACV, which generates high likelihood disparity hypotheses and the corresponding attention weights from low-resolution correlation clues to significantly reduce computational and memory cost and meanwhile maintain a satisfactory accuracy. Furthermore, we design a highly accurate network ACVNet and a real-time network Fast-ACVNet based on our ACV and Fast-ACV respectively, which achieve state-of-the-art performance on several benchmarks.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TPAMI.2023.3335480DOI Listing

Publication Analysis

Top Keywords

stereo matching
16
concatenation volume
12
attention concatenation
8
cost volume
8
volume acv
8
attention weights
8
correlation clues
8
accuracy design
8
volume
5
accurate efficient
4

Similar Publications

Stereo-seq of the prefrontal cortex in aging and Alzheimer's disease.

Nat Commun

January 2025

Tulane Center for Biomedical Informatics and Genomics, Deming Department of Medicine, School of Medicine, Tulane University, New Orleans, LA, 70112, USA.

Aging increases the risk for Alzheimer's disease (AD), driving pathological changes like amyloid-β (Aβ) buildup, inflammation, and oxidative stress, especially in the prefrontal cortex (PFC). We present the first subcellular-resolution spatial transcriptome atlas of the human prefrontal cortex (PFC), generated with Stereo-seq from six male AD cases at varying neuropathological stages and six age-matched male controls. Our analyses revealed distinct transcriptional alterations across PFC layers, highlighted disruptions in laminar structure, and exposed AD-related shifts in layer-to-layer and cell-cell interactions.

View Article and Find Full Text PDF

Objective: Somatic variants causing epilepsy are challenging to detect, as they are only present in a subset of brain cells (e.g., mosaic), resulting in low variant allele frequencies.

View Article and Find Full Text PDF

We report a stereo-differentiating dynamic kinetic asymmetric Rh(I)-catalyzed Pauson-Khand reaction, which provides access to an array of thapsigargin stereoisomers. Using catalyst-control, a consistent stereochemical outcome is achieved at C2─for both matched and mismatched cases─regardless of the allene-yne C8 stereochemistry. The stereochemical configuration for all stereoisomers was assigned by comparing experimental vibrational circular dichroism (VCD) and C NMR to DFT-computed spectra.

View Article and Find Full Text PDF

This paper presents a novel method to enhance ground truth disparity maps generated by Semi-Global Matching (SGM) using Maximum a Posteriori (MAP) estimation. SGM, while not producing visually appealing outputs like neural networks, offers high disparity accuracy in valid regions and avoids the generalization issues often encountered with neural network-based disparity estimation. However, SGM struggles with occlusions and textureless areas, leading to invalid disparity values.

View Article and Find Full Text PDF

: There remains a lack of compelling objective evidence on whether stereopsis is necessary for an ophthalmic surgical career. It is also unclear if high-grade stereoacuity correlates with better surgical performance. The present study attempts to address this question by comparing the simulated surgical performance of subjects with different levels of stereoacuity using a virtual reality (VR) intraocular surgical simulator (EYESi, VRmagic, Mannheim, Germany).

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!