Behavior sequences are generated by a series of spatio-temporal interactions and have a high-dimensional nonlinear manifold structure. Therefore, it is difficult to learn 3D behavior representations without relying on supervised signals. To this end, self-supervised learning methods can be used to explore the rich information contained in the data itself. Context-context contrastive self-supervised methods construct the manifold embedded in Euclidean space by learning the distance relationship between data, and find the geometric distribution of data. However, traditional Euclidean space is difficult to express context joint features. In order to obtain an effective global representation from the relationship between data under unlabeled conditions, this paper adopts contrastive learning to compare global feature, and proposes a self-supervised learning method based on hyperbolic embedding to mine the nonlinear relationship of behavior trajectories. This method adopts the framework of discarding negative samples, which overcomes the shortcomings of the paradigm based on positive and negative samples that pull similar data away in the feature space. Meanwhile, the output of the network is embedded in a hyperbolic space, and a multi-layer perceptron is added to convert the entire module into a homotopic mapping by using the geometric properties of operations in the hyperbolic space, so as to obtain homotopy invariant knowledge. The proposed method combines the geometric properties of hyperbolic manifolds and the equivariance of homotopy groups to promote better supervised signals for the network, which improves the performance of unsupervised learning.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TIP.2023.3328230DOI Listing

Publication Analysis

Top Keywords

hyperbolic embedding
8
supervised signals
8
self-supervised learning
8
euclidean space
8
relationship data
8
negative samples
8
hyperbolic space
8
geometric properties
8
learning
6
hyperbolic
5

Similar Publications

Single-cell RNA sequencing (scRNA-seq) offers remarkable insights into cellular development and differentiation by capturing the gene expression profiles of individual cells. The role of dimensionality reduction and visualization in the interpretation of scRNA-seq data has gained widely acceptance. However, current methods face several challenges, including incomplete structure-preserving strategies and high distortion in embeddings, which fail to effectively model complex cell trajectories with multiple branches.

View Article and Find Full Text PDF

Deep learning has shown significant value in automating radiological diagnostics but can be limited by a lack of generalizability to external datasets. Leveraging the geometric principles of non-Euclidean space, certain geometric deep learning approaches may offer an alternative means of improving model generalizability. This study investigates the potential advantages of hyperbolic convolutional neural networks (HCNNs) over traditional convolutional neural networks (CNNs) in neuroimaging tasks.

View Article and Find Full Text PDF

Adaptive data embedding for curved spaces.

iScience

December 2024

Computational Neurobiology Laboratory, The Salk Institute for Biological Studies, La Jolla, CA, USA.

Recent studies have demonstrated the significance of hyperbolic geometry in uncovering low-dimensional structure within complex hierarchical systems. We developed a Bayesian formulation of multi-dimensional scaling (MDS) for embedding data in hyperbolic spaces that allows for a principled determination of manifold parameters such as curvature and dimension. We show that only a small amount of data are needed to constrain the manifold, the optimization is robust against false minima, and the model is able to correctly discern between Hyperbolic and Euclidean data.

View Article and Find Full Text PDF

We give a description of the Hallnäs-Ruijsenaars eigenfunctions of the 2-particle hyperbolic Ruijsenaars system as matrix coefficients for the order 4 element acting on the Hilbert space of (2) quantum Teichmüller theory on the punctured torus. The (2) Macdonald polynomials are then obtained as special values of the analytic continuation of these matrix coefficients. The main tool used in the proof is the cluster structure on the moduli space of framed (2)-local systems on the punctured torus, and an -equivariant embedding of the (2) spherical DAHA into the quantized coordinate ring of the corresponding cluster Poisson variety.

View Article and Find Full Text PDF

Differentiating atypical parkinsonian syndromes with hyperbolic few-shot contrastive learning.

Neuroimage

December 2024

School of Computer Science and Engineering, Pusan National University, Busan 46241, South Korea; Center for Artificial Intelligence Research, Pusan National University, Busan 46241, South Korea. Electronic address:

Article Synopsis
  • Differences in iron accumulation patterns in atypical parkinsonian syndromes can be identified using susceptibility-weighted images, and deep learning methods are effective for this task.
  • Traditional deep learning models need large labeled datasets, which are expensive and can compromise patient privacy.
  • A new few-shot learning framework is proposed to distinguish between multiple system atrophy parkinsonian (MSA-P) and progressive supranuclear palsy (PSP) using fewer data samples, achieving better performance through enhanced feature identification and a novel hyperbolic space technique.
View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!