Behavior sequences are generated by a series of spatio-temporal interactions and have a high-dimensional nonlinear manifold structure. Therefore, it is difficult to learn 3D behavior representations without relying on supervised signals. To this end, self-supervised learning methods can be used to explore the rich information contained in the data itself. Context-context contrastive self-supervised methods construct the manifold embedded in Euclidean space by learning the distance relationship between data, and find the geometric distribution of data. However, traditional Euclidean space is difficult to express context joint features. In order to obtain an effective global representation from the relationship between data under unlabeled conditions, this paper adopts contrastive learning to compare global feature, and proposes a self-supervised learning method based on hyperbolic embedding to mine the nonlinear relationship of behavior trajectories. This method adopts the framework of discarding negative samples, which overcomes the shortcomings of the paradigm based on positive and negative samples that pull similar data away in the feature space. Meanwhile, the output of the network is embedded in a hyperbolic space, and a multi-layer perceptron is added to convert the entire module into a homotopic mapping by using the geometric properties of operations in the hyperbolic space, so as to obtain homotopy invariant knowledge. The proposed method combines the geometric properties of hyperbolic manifolds and the equivariance of homotopy groups to promote better supervised signals for the network, which improves the performance of unsupervised learning.
Download full-text PDF |
Source |
---|---|
http://dx.doi.org/10.1109/TIP.2023.3328230 | DOI Listing |
Brief Bioinform
November 2024
School of Engineering, Westlake University, No. 600 Dunyu Road, 310030 Zhejiang, P.R. China.
Single-cell RNA sequencing (scRNA-seq) offers remarkable insights into cellular development and differentiation by capturing the gene expression profiles of individual cells. The role of dimensionality reduction and visualization in the interpretation of scRNA-seq data has gained widely acceptance. However, current methods face several challenges, including incomplete structure-preserving strategies and high distortion in embeddings, which fail to effectively model complex cell trajectories with multiple branches.
View Article and Find Full Text PDFJ Imaging
December 2024
Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA 02115, USA.
Deep learning has shown significant value in automating radiological diagnostics but can be limited by a lack of generalizability to external datasets. Leveraging the geometric principles of non-Euclidean space, certain geometric deep learning approaches may offer an alternative means of improving model generalizability. This study investigates the potential advantages of hyperbolic convolutional neural networks (HCNNs) over traditional convolutional neural networks (CNNs) in neuroimaging tasks.
View Article and Find Full Text PDFiScience
December 2024
Computational Neurobiology Laboratory, The Salk Institute for Biological Studies, La Jolla, CA, USA.
Recent studies have demonstrated the significance of hyperbolic geometry in uncovering low-dimensional structure within complex hierarchical systems. We developed a Bayesian formulation of multi-dimensional scaling (MDS) for embedding data in hyperbolic spaces that allows for a principled determination of manifold parameters such as curvature and dimension. We show that only a small amount of data are needed to constrain the manifold, the optimization is robust against false minima, and the model is able to correctly discern between Hyperbolic and Euclidean data.
View Article and Find Full Text PDFLett Math Phys
November 2024
University of Edinburgh, Edinburgh, UK.
We give a description of the Hallnäs-Ruijsenaars eigenfunctions of the 2-particle hyperbolic Ruijsenaars system as matrix coefficients for the order 4 element acting on the Hilbert space of (2) quantum Teichmüller theory on the punctured torus. The (2) Macdonald polynomials are then obtained as special values of the analytic continuation of these matrix coefficients. The main tool used in the proof is the cluster structure on the moduli space of framed (2)-local systems on the punctured torus, and an -equivariant embedding of the (2) spherical DAHA into the quantized coordinate ring of the corresponding cluster Poisson variety.
View Article and Find Full Text PDFNeuroimage
December 2024
School of Computer Science and Engineering, Pusan National University, Busan 46241, South Korea; Center for Artificial Intelligence Research, Pusan National University, Busan 46241, South Korea. Electronic address:
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!