This work is intended as a voice in the discussion over previous claims that a pretrained large language model (LLM) based on the Transformer model architecture can be sentient. Such claims have been made concerning the LaMDA model and also concerning the current wave of LLM-powered chatbots, such as ChatGPT. This claim, if confirmed, would have serious ramifications in the Natural Language Processing (NLP) community due to wide-spread use of similar models. However, here we take the position that such a large language model cannot be conscious, and that LaMDA in particular exhibits no advances over other similar models that would qualify it. We justify this by analysing the Transformer architecture through Integrated Information Theory of consciousness. We see the claims of sentience as part of a wider tendency to use anthropomorphic language in NLP reporting. Regardless of the veracity of the claims, we consider this an opportune moment to take stock of progress in language modelling and consider the ethical implications of the task. In order to make this work helpful for readers outside the NLP community, we also present the necessary background in language modelling.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11617003 | PMC |
| http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0307521 | PLOS |
Publication Analysis
Top Keywords
Similar Publications
Differential Response to Cisplatin between Co-cultured Cells and Pure Cultured Cells Based on Single-cell RNA Sequencing of Three-dimensional-cultured Breast Cancer Cells.
Front Biosci (Landmark Ed)
November 2024
Department of Breast Surgery, The First People's Hospital of Foshan, 528100 Foshan, Guangdong, China.
Objective: The current study aimed to develop an experimental approach for the direct co-culture of three-dimensional breast cancer cells using single-cell RNA sequencing (scRNA-seq).
Methods: The following four cell culture groups were established in the Matrigel matrix: the untreated Michigan Cancer Foundation (MCF)-7 cell culture group, the MCF-7 cell culture plus cisplatin group, the untreated co-culture group, and the cell co-culture plus cisplatin group. For cell co-culture, MCF-7 cells, human mammary fibroblasts, and human umbilical vein endothelial cells were mixed at a ratio of 1:1:1.
Using Implementation Science to Evaluate the Implementation of Patient-Reported Outcome Measures (PROMs) in a Clinical Heart Failure Care Setting.
CJC Open
December 2024
University Health Network, Toronto, Ontario, Canada.
Background: Patients with heart failure (HF) can experience a poor quality-of-life (QOL), recurring hospitalizations, and progressive disease symptoms. Patient-reported outcome measures (PROMs) integrate patients' voices into clinical care, by assessing patient symptoms, function, and QOL. In 2022, PROMs were incorporated into the electronic health record system (Epic) at a large academic hospital in Toronto, Ontario, Canada.
View Article and Find Full Text PDFMachine-Learning-Aided Engineering Hemoglobin as Carbene Transferase for Catalyzing Enantioselective Olefin Cyclopropanation.
JACS Au
December 2024
Key Laboratory of Molecular Enzymology and Engineering of Ministry of Education, School of Life Sciences, Jilin University, Changchun 130023, P. R. China.
In this study, we developed a machine-learning-aided protein design strategy for engineering hemoglobin (VHb) as carbene transferase. A Natural Language Processing (NLP) model was used for the first time to construct an algorithm (EESP, enzyme enantioselectivity score predictor) and predict the enantioselectivity of VHb. We identified critical amino acid residue sites by molecular docking and established a simplified mutation library by site-saturated mutagenesis.
View Article and Find Full Text PDFxMEN: a modular toolkit for cross-lingual medical entity normalization.
JAMIA Open
February 2025
Hasso Plattner Institute for Digital Engineering, University of Potsdam, Potsdam 14482, Germany.
Objective: To improve performance of medical entity normalization across many languages, especially when fewer language resources are available compared to English.
Materials And Methods: We propose xMEN, a modular system for cross-lingual (x) medical entity normalization (MEN), accommodating both low- and high-resource scenarios. To account for the scarcity of aliases for many target languages and terminologies, we leverage multilingual aliases via cross-lingual candidate generation.
Examining the role of intrinsic and extrinsic cues from service requirement narratives in web-based time banking participation decisions.
Front Public Health
December 2024
College of Management and Institute of Big Data, Intelligent Management and Decision, Shenzhen University, Shenzhen, China.
Introduction: Time banking, known as "Community/Neighborhood Pension," instantiates a form of co-creation that can provide a new solution to fulfil the unmet social service needs of community members with idle resources, which is a feasible solution to alleviate pension pressure. The sustainable operation of time banks relies on the co-creation and active participation of community members. Therefore, in this study, we investigate the motivation of members to participate in web-based time banks from a service requirement narrative perspective.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!