AI Article Synopsis

  • The research investigates the use of GPT models for automated psychological text analysis across 15 datasets consisting of nearly 48,000 annotated tweets and news headlines in 12 languages.
  • Results indicate that GPT outperformed traditional English-language dictionary analysis and sometimes matched or exceeded the performance of advanced machine learning models, particularly benefiting lesser-spoken languages.
  • The study suggests that GPT simplifies and democratizes automated text analysis, making it more accessible for researchers with little coding experience, and encourages further research in understudied languages.

Article Abstract

The social and behavioral sciences have been increasingly using automated text analysis to measure psychological constructs in text. We explore whether GPT, the large-language model (LLM) underlying the AI chatbot ChatGPT, can be used as a tool for automated psychological text analysis in several languages. Across 15 datasets ( = 47,925 manually annotated tweets and news headlines), we tested whether different versions of GPT (3.5 Turbo, 4, and 4 Turbo) can accurately detect psychological constructs (sentiment, discrete emotions, offensiveness, and moral foundations) across 12 languages. We found that GPT ( = 0.59 to 0.77) performed much better than English-language dictionary analysis ( = 0.20 to 0.30) at detecting psychological constructs as judged by manual annotators. GPT performed nearly as well as, and sometimes better than, several top-performing fine-tuned machine learning models. Moreover, GPT's performance improved across successive versions of the model, particularly for lesser-spoken languages, and became less expensive. Overall, GPT may be superior to many existing methods of automated text analysis, since it achieves relatively high accuracy across many languages, requires no training data, and is easy to use with simple prompts (e.g., "is this text negative?") and little coding experience. We provide sample code and a video tutorial for analyzing text with the GPT application programming interface. We argue that GPT and other LLMs help democratize automated text analysis by making advanced natural language processing capabilities more accessible, and may help facilitate more cross-linguistic research with understudied languages.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11348013PMC
http://dx.doi.org/10.1073/pnas.2308950121DOI Listing

Publication Analysis

Top Keywords

text analysis
20
automated text
12
psychological constructs
12
gpt
8
text
8
psychological text
8
analysis
6
psychological
5
languages
5
gpt effective
4

Similar Publications

The Antibody Mediated Prevention (AMP) trials showed that passively infused VRC01, a broadly neutralizing antibody (bNAb) targeting the CD4 binding site (CD4bs) on the HIV-1 envelope protein (Env), protected against neutralization-sensitive viruses. We identified six individuals from the VRC01 treatment arm with multi-lineage breakthrough HIV-1 infections from HVTN703, where one variant was sensitive to VRC01 (IC < 25 ug/mL) but another was resistant. By comparing Env sequences of resistant and sensitive clones from each participant, we identified sites predicted to affect VRC01 neutralization and assessed the effect of their reversion in the VRC01-resistant clone on neutralization sensitivity.

View Article and Find Full Text PDF

Objectives: Advanced therapy medicinal products (ATMPs) are transformative healthcare interventions, however, there has been limited research exploring their value. The objective of this study was to conduct a thematic analysis as part of a documentary analysis to identify value attributes of ATMPs.

Methods: As part of the NICE assessment processes in England, stakeholders are invited to provide comments on the technology.

View Article and Find Full Text PDF

The analysis of social networks enables the understanding of social interactions, polarization of ideas and the spread of information, and therefore plays an important role in society. We use Twitter data-as it is a popular venue for the expression of opinion and dissemination of information-to identify opposing sides of a debate and, importantly, to observe how information spreads between these groups in our current polarized climate. To achieve this, we collected over 688 000 tweets from the Irish Abortion Referendum of 2018 to build a conversation network from users' mentions with sentiment-based homophily.

View Article and Find Full Text PDF

Study Objectives: To assess the effect of continuous positive airway pressure (CPAP) therapy on intraocular pressure in Obstructive sleep apnea (OSA) patients.

Methods: The search was performed in Ovid Medline and Embase database then followed by a manual bibliography search. Abstract search and screening were independently performed followed by eligible full-text versions reviewed.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!