Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model.

Sensors (Basel)

Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia.

Published: May 2023

Sentiment is currently one of the most emerging areas of research due to the large amount of web content coming from social networking websites. Sentiment analysis is a crucial process for recommending systems for most people. Generally, the purpose of sentiment analysis is to determine an author's attitude toward a subject or the overall tone of a document. There is a huge collection of studies that make an effort to predict how useful online reviews will be and have produced conflicting results on the efficacy of different methodologies. Furthermore, many of the current solutions employ manual feature generation and conventional shallow learning methods, which restrict generalization. As a result, the goal of this research is to develop a general approach using transfer learning by applying the "BERT (Bidirectional Encoder Representations from Transformers)"-based model. The efficiency of BERT classification is then evaluated by comparing it with similar machine learning techniques. In the experimental evaluation, the proposed model demonstrated superior performance in terms of outstanding prediction and high accuracy compared to earlier research. Comparative tests conducted on positive and negative Yelp reviews reveal that fine-tuned BERT classification performs better than other approaches. In addition, it is observed that BERT classifiers using batch size and sequence length significantly affect classification performance.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255967PMC
http://dx.doi.org/10.3390/s23115232DOI Listing

Publication Analysis

Top Keywords

transfer learning
8
bidirectional encoder
8
encoder representations
8
sentiment analysis
8
bert classification
8
sentiment
4
learning sentiment
4
classification
4
sentiment classification
4
classification bidirectional
4

Similar Publications

Introduction: Wearables are electronic devices worn on the body to collect health data. These devices, like smartwatches and patches, use sensors to gather information on various health parameters. This review highlights current use and the potential benefit of wearable technology in patients with inflammatory bowel disease (IBD).

View Article and Find Full Text PDF

Chronic obstructive pulmonary disease (COPD) is a prevalent chronic inflammatory airway disease with high incidence and significant disease burden. R-loops, functional chromatin structure formed during transcription, are closely associated with inflammation due to its aberrant formation. However, the role of R-loop regulators (RLRs) in COPD remains unclear.

View Article and Find Full Text PDF

This study investigates the electronic properties and photovoltaic (PV) performance of newly designed bithiophene-based dyes, focusing on their light harvesting efficiency (LHE), open-circuit voltage (V), fill factor (FF), and short-circuit current density (J).These new dyes are designed with the help of machine learning (ML) to design best donor acceptor designs. For this, we collect 2567 differenr electron donor groups and calculated their bandgap with the help of Random Forest (RF) Regression method.

View Article and Find Full Text PDF

IL-33, a neutrophil extracellular trap-related gene involved in the progression of diabetic kidney disease.

Inflamm Res

January 2025

Department of Nephrology, First Affiliated Hospital of Naval Medical University, Shanghai Changhai Hospital, Shanghai, China.

Background: Chronic inflammation is well recognized as a key factor related to renal function deterioration in patients with diabetic kidney disease (DKD). Neutrophil extracellular traps (NETs) play an important role in amplifying inflammation. With respect to NET-related genes, the aim of this study was to explore the mechanism of DKD progression and therefore identify potential intervention targets.

View Article and Find Full Text PDF

Soil microbiota plays crucial roles in maintaining the health, productivity, and nutrient cycling of terrestrial ecosystems. The persistence and prevalence of heterocyclic compounds in soil pose significant risks to soil health. However, understanding the links between heterocyclic compounds and microbial responses remains challenging due to the complexity of microbial communities and their various chemical structures.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!