Distant supervision for neural relation extraction is an efficient approach to extracting massive relations with reference to plain texts. However, the existing neural methods fail to capture the critical words in sentence encoding and meanwhile lack useful sentence information for some positive training instances. To address the above issues, we propose a novel neural relation extraction model. First, we develop a word-level attention mechanism to distinguish the importance of each individual word in a sentence, increasing the attention weights for those critical words. Second, we investigate the semantic information from word embeddings of target entities, which can be developed as a supplementary feature for the extractor. Experimental results show that our model outperforms previous state-of-the-art baselines.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.neunet.2018.01.006 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Abnormally slow dynamics in occipital cortex of depression.
J Affect Disord
January 2025
University of Ottawa Institute of Mental Health Research, University of Ottawa, Ottawa, Canada. Electronic address:
Aim: Major depressive disorder (MDD) is characterized by altered activity in various higher-order regions like the anterior cingulate and prefrontal cortex. While some findings also show changes in lower-order sensory regions like the occipital cortex in MDD, the latter's exact neural and temporal, e.g.
View Article and Find Full Text PDFSex Differences in the Striatal Contributions to Longitudinal Fine Motor Development in Autistic Children.
Biol Psychiatry
January 2025
MIND Institute and Department of Psychiatry and Behavioral Sciences, UC Davis School of Medicine, University of California Davis, Sacramento, CA, USA.
Background: Fine motor challenges are prevalent in autistic populations. However, little is known about their neurobiological underpinnings or how their related neural mechanisms are influenced by sex. The dorsal striatum, comprised of the caudate nucleus and putamen, is associated with motor learning and control and may hold critical information.
View Article and Find Full Text PDFThe role of the hippocampus in working memory and word reading: Novel neural correlates of reading among youth living in the context of economic disadvantage.
Dev Cogn Neurosci
December 2024
Child Mind Institute, New York, NY, USA; Department of Psychiatry and Behavioral Health, The Ohio State University, Columbus, OH, USA. Electronic address:
A left-lateralized cortical reading circuit underlies successful reading and fails to engage in individuals with reading problems. Studies identifying this circuit included youth from economically advantaged backgrounds and focused on cortical, not subcortical, structures. However, among youth with low scores on reading tests who are living in the context of economic disadvantage, this brain network is actively engaged during reading, despite persistent reading problems.
View Article and Find Full Text PDFA universal strategy for smoothing deceleration in deep graph neural networks.
Neural Netw
January 2025
College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin, 150001, China. Electronic address:
Graph neural networks (GNNs) have shown great promise in modeling graph-structured data, but the over-smoothing problem restricts their effectiveness in deep layers. Two key weaknesses of existing research on deep GNN models are: (1) ignoring the beneficial aspects of intra-class smoothing while focusing solely on reducing inter-class smoothing, and (2) inefficient computation of residual weights that neglect the influence of neighboring nodes' distributions. To address these weaknesses, we propose a novel Smoothing Deceleration (SD) strategy to reduce the smoothing speed rate of nodes as information propagates between layers, thereby mitigating over-smoothing.
View Article and Find Full Text PDFDynamic planning in hierarchical active inference.
Neural Netw
January 2025
Institute of Cognitive Sciences and Technologies, National Research Council, Padova, Italy. Electronic address:
By dynamic planning, we refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. A recent paradigm, active inference, brings fundamental insights into the adaptation of biological organisms, constantly striving to minimize prediction errors to restrict themselves to life-compatible states. Over the past years, many studies have shown how human and animal behaviors could be explained in terms of active inference - either as discrete decision-making or continuous motor control - inspiring innovative solutions in robotics and artificial intelligence.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!