Background: Medical image analysis, particularly in the context of visual question answering (VQA) and image captioning, is crucial for accurate diagnosis and educational purposes.
Objective: Our study aims to introduce BioMedBLIP models, fine-tuned for VQA tasks using specialized medical data sets such as Radiology Objects in Context and Medical Information Mart for Intensive Care-Chest X-ray, and evaluate their performance in comparison to the state of the art (SOTA) original Bootstrapping Language-Image Pretraining (BLIP) model.
Methods: We present 9 versions of BioMedBLIP across 3 downstream tasks in various data sets.
Background: Breast cancer is the leading cause of cancer-related fatalities among women worldwide. Conventional screening and risk prediction models primarily rely on demographic and patient clinical history to devise policies and estimate likelihood. However, recent advancements in artificial intelligence (AI) techniques, particularly deep learning (DL), have shown promise in the development of personalized risk models.
View Article and Find Full Text PDFAnnu Int Conf IEEE Eng Med Biol Soc
July 2023
Detection of metastatic breast cancer lesions is a challenging task in breast cancer treatment. The recent advancements in deep learning gained attention owing to its robustness, particularly in addressing automated segmentation and classification issues in medical images. In this paper, we proposed a modified Swin Transformer model (mST) integrated with a novel Multi-Level Adaptive Feature Fusion (MLAFF) Module.
View Article and Find Full Text PDFBackground: Recent advancements in computing power and state-of-the-art algorithms have helped in more accessible and accurate diagnosis of numerous diseases. In addition, the development of de novo areas in imaging science, such as radiomics and radiogenomics, have been adding more to personalize healthcare to stratify patients better. These techniques associate imaging phenotypes with the related disease genes.
View Article and Find Full Text PDFIEEE J Biomed Health Inform
July 2024
The integration of healthcare monitoring with Internet of Things (IoT) networks radically transforms the management and monitoring of human well-being. Portable and lightweight electroencephalography (EEG) systems with fewer electrodes have improved convenience and flexibility while retaining adequate accuracy. However, challenges emerge when dealing with real-time EEG data from IoT devices due to the presence of noisy samples, which impedes improvements in brainwave detection accuracy.
View Article and Find Full Text PDFIEEE J Biomed Health Inform
July 2023
Pathology imaging is routinely used to detect the underlying effects and causes of diseases or injuries. Pathology visual question answering (PathVQA) aims to enable computers to answer questions about clinical visual findings from pathology images. Prior work on PathVQA has focused on directly analyzing the image content using conventional pretrained encoders without utilizing relevant external information when the image content is inadequate.
View Article and Find Full Text PDFIEEE Trans Neural Netw Learn Syst
October 2024
The rapid growth of social media has caused tremendous effects on information propagation, raising extreme challenges in detecting rumors. Existing rumor detection methods typically exploit the reposting propagation of a rumor candidate for detection by regarding all reposts to a rumor candidate as a temporal sequence and learning semantics representations of the repost sequence. However, extracting informative support from the topological structure of propagation and the influence of reposting authors for debunking rumors is crucial, which generally has not been well addressed by existing methods.
View Article and Find Full Text PDFDue to the increasing interest of people in the stock and financial market, the sentiment analysis of news and texts related to the sector is of utmost importance. This helps the potential investors in deciding what company to invest in and what are their long-term benefits. However, it is challenging to analyze the sentiments of texts related to the financial domain, given the enormous amount of information available.
View Article and Find Full Text PDFBackground: Text mining in the biomedical field has received much attention and regarded as the important research area since a lot of biomedical data is in text format. Topic modeling is one of the popular methods among text mining techniques used to discover hidden semantic structures, so called topics. However, discovering topics from biomedical data is a challenging task due to the sparsity, redundancy, and unstructured format.
View Article and Find Full Text PDFBackground: The abundance of biomedical text data coupled with advances in natural language processing (NLP) is resulting in novel biomedical NLP (BioNLP) applications. These NLP applications, or tasks, are reliant on the availability of domain-specific language models (LMs) that are trained on a massive amount of data. Most of the existing domain-specific LMs adopted bidirectional encoder representations from transformers (BERT) architecture which has limitations, and their generalizability is unproven as there is an absence of baseline results among common BioNLP tasks.
View Article and Find Full Text PDFThe coronavirus (COVID-19) pandemic has had a terrible impact on human lives globally, with far-reaching consequences for the health and well-being of many people around the world. Statistically, 305.9 million people worldwide tested positive for COVID-19, and 5.
View Article and Find Full Text PDFIEEE J Biomed Health Inform
April 2023
Pathology visual question answering (PathVQA) attempts to answer a medical question posed by pathology images. Despite its great potential in healthcare, it is not widely adopted because it requires interactions on both the image (vision) and question (language) to generate an answer. Existing methods focused on treating vision and language features independently, which were unable to capture the high and low-level interactions that are required for VQA.
View Article and Find Full Text PDFThis work investigates the use of distance learning in saving students' academic year amid COVID-19 lockdown. It assesses the adoption of distance learning using various online application tools that have gained widespread attention during the coronavirus infectious disease 2019 (COVID-19) pandemic. Distance learning thrives as a legitimate alternative to classroom instructions, as major cities around the globe are locked down amid the COVID-19 pandemic.
View Article and Find Full Text PDFIEEE Trans Comput Soc Syst
August 2021
Social media (and the world at large) have been awash with news of the COVID-19 pandemic. With the passage of time, news and awareness about COVID-19 spread like the pandemic itself, with an explosion of messages, updates, videos, and posts. Mass hysteria manifest as another concern in addition to the health risk that COVID-19 presented.
View Article and Find Full Text PDFBackground: Educational institutes around the globe are facing challenges of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Online learning is being carried out to avoid face to face contact in emergency scenarios such as coronavirus infectious disease 2019 (COVID-19) pandemic. Students need to adapt to new roles of learning through information technology to succeed in academics amid COVID-19.
View Article and Find Full Text PDF