LollipopE: Bi-centered lollipop embedding for complex logic query on knowledge graph.

Neural Netw

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190, China; Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100190, China; University of Chinese Academy of Sciences, Beijing, 100190, China; School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, 100190, China.

Published: July 2024

Answering complex First-Order Logic (FOL) query plays a vital role in multi-hop knowledge graph (KG) reasoning. Geometric methods have emerged as a promising category of approaches in this context. However, existing best-performing geometric query embedding (QE) model is still up against three-fold potential problems: (i) underutilization of embedding space, (ii) overreliance on angle information, (iii) uncaptured hierarchy structure. To bridge the gap, we propose a lollipop-like bi-centered query embedding method named LollipopE. To fully utilize embedding space, LollipopE employs learnable centroid positions to represent multiple entities distributed along the same axis. To address the potential overreliance on angular metrics, we design an angular-based and centroid-based metric. This involves calculating both an angular distance and a centroid-based geodesic distance, which empowers the model to make more informed selections of relevant answers from a wider perspective. To effectively capture the hierarchical relationships among entities within the KG, we incorporate dynamic moduli, which allows for the representation of the hierarchical structure among entities. Extensive experiments demonstrate that LollipopE surpasses the state-of-the-art geometric methods. Especially, on more hierarchical datasets, LollipopE achieves the most significant improvement.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.106277DOI Listing

Publication Analysis

Top Keywords

knowledge graph
8
geometric methods
8
query embedding
8
embedding space
8
lollipope
5
embedding
5
lollipope bi-centered
4
bi-centered lollipop
4
lollipop embedding
4
embedding complex
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!