Short-Text Classification Detector: A Bert-Based Mental Approach.

Comput Intell Neurosci

School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China.

Published: March 2022

With the continuous development of the Internet, social media based on short text has become popular. However, the sparsity and shortness of essays will restrict the accuracy of text classification. Therefore, based on the Bert model, we capture the mental feature of reviewers and apply them for short text classification to improve its classification accuracy. Specifically, we construct a model text at the language level and fine tune the model to better embed mental features. To verify the accuracy of this method, we compare a variety of machine learning methods, such as support vector machine, convolution neural networks, and recurrent neural networks. The results show the following: (1) Through feature comparison, it is found that mental features can significantly improve the accuracy of short text classification. (2) Combining mental features and text as input vectors can provide more classification accuracy than separating them as two independent vectors. (3) Through model comparison, it can be found that Bert model can integrate mental features and short text. Bert can better capture mental features to improve the accuracy of classification results. This will help to promote the development of short text classification.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8930219PMC
http://dx.doi.org/10.1155/2022/8660828DOI Listing

Publication Analysis

Top Keywords

short text
20
mental features
20
text classification
16
text
8
bert model
8
capture mental
8
classification accuracy
8
neural networks
8
features improve
8
improve accuracy
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!