Publications by authors named "Francesco Caliva"

Although fully automated volumetric approaches for monitoring brain tumor response have many advantages, most available deep learning models are optimized for highly curated, multi-contrast MRI from newly diagnosed gliomas, which are not representative of post-treatment cases in the clinic. Improving segmentation for treated patients is critical to accurately tracking changes in response to therapy. We investigated mixing data from newly diagnosed ( = 208) and treated ( = 221) gliomas in training, applying transfer learning (TL) from pre- to post-treatment imaging domains, and incorporating spatial regularization for T2-lesion segmentation using only T2 FLAIR images as input to improve generalization post-treatment.

View Article and Find Full Text PDF

Background: The purpose of this study was to develop a deep learning approach to automatically segment the scapular bone on magnetic resonance imaging (MRI) images and to compare the accuracy of these three-dimensional (3D) models with that of 3D computed tomography (CT).

Methods: Fifty-five patients with high-resolution 3D fat-saturated T2 MRI were retrospectively identified. The underlying pathology included rotator cuff tendinopathy and tears, shoulder instability, and impingement.

View Article and Find Full Text PDF

Objective: Although it is established that structural damage of the meniscus is linked to knee osteoarthritis (OA) progression, the predisposition to future development of OA because of geometric meniscal shapes is plausible and unexplored. This study aims to identify common variations in meniscal shape and determine their relationships to tissue morphology, OA onset, and longitudinal changes in cartilage thickness.

Methods: A total of 4,790 participants from the Osteoarthritis Initiative data set were studied.

View Article and Find Full Text PDF

Cartilage thickness change is a well-documented biomarker of osteoarthritis pathogenesis. However, there is still much to learn about the spatial and temporal patterns of cartilage thickness change in health and disease. In this study, we develop a novel analysis method for elucidating such patterns using a functional connectivity approach.

View Article and Find Full Text PDF

Purpose: To perform patellofemoral joint (PFJ) geometric measurements on knee magnetic resonance imaging scans and determine their relations with chondral lesions in a multicenter cohort using deep learning.

Methods: The sagittal tibial tubercle-trochlear groove (sTTTG) distance, tibial tubercle-trochlear groove distance, trochlear sulcus angle, trochlear depth, Caton-Deschamps Index (CDI), and flexion angle were measured by use of deep learning-generated segmentations on a subset of the Osteoarthritis Initiative study with radiologist-graded PFJ cartilage grades (n = 2,461). Kruskal-Wallis H tests were performed to compare differences in PFJ morphology between subjects without PFJ osteoarthritis (OA) and those with PFJ OA.

View Article and Find Full Text PDF

MRI T mapping sequences quantitatively assess tissue health and depict early degenerative changes in musculoskeletal (MSK) tissues like cartilage and intervertebral discs (IVDs) but require long acquisition times. In MSK imaging, small features in cartilage and IVDs are crucial for diagnoses and must be preserved when reconstructing accelerated data. To these ends, we propose region of interest-specific postprocessing of accelerated acquisitions: a recurrent UNet deep learning architecture that provides T maps in knee cartilage, hip cartilage, and lumbar spine IVDs from accelerated T-prepared snapshot gradient-echo acquisitions, optimizing for cartilage and IVD performance with a multi-component loss function that most heavily penalizes errors in those regions.

View Article and Find Full Text PDF

Bone shape changes are considered a relevant biomarker in understanding the onset and progression of knee osteoarthritis (OA). This study used a novel deep learning pipeline to predict longitudinal bone shape changes in the femur four years in advance, using bone surfaces that were extracted in knee MRIs from the OA initiative study, via a segmentation procedure and encoded as shape maps using spherical coordinates. Given a sequence of three consecutive shape maps (collected in a time window of 24 months), a fully convolutional network was trained to predict the whole bone surface 48 months after the last observed time point, and a classifier to diagnose OA in the predicted maps.

View Article and Find Full Text PDF

The 3D nature and soft-tissue contrast of MRI makes it an invaluable tool for osteoarthritis research, by facilitating the elucidation of disease pathogenesis and progression. The recent increasing employment of MRI has certainly been stimulated by major advances that are due to considerable investment in research, particularly related to artificial intelligence (AI). These AI-related advances are revolutionizing the use of MRI in clinical research by augmenting activities ranging from image acquisition to post-processing.

View Article and Find Full Text PDF

Knee pain is the most common and debilitating symptom of knee osteoarthritis (OA). While there is a perceived association between OA imaging biomarkers and pain, there are weak or conflicting findings for this relationship. This study uses Deep Learning (DL) models to elucidate associations between bone shape, cartilage thickness and T relaxation times extracted from Magnetic Resonance Images (MRI) and chronic knee pain.

View Article and Find Full Text PDF

Purpose Of Review: In this paper, we discuss how recent advancements in image processing and machine learning (ML) are shaping a new and exciting era for the osteoporosis imaging field. With this paper, we want to give the reader a basic exposure to the ML concepts that are necessary to build effective solutions for image processing and interpretation, while presenting an overview of the state of the art in the application of machine learning techniques for the assessment of bone structure, osteoporosis diagnosis, fracture detection, and risk prediction.

Recent Findings: ML effort in the osteoporosis imaging field is largely characterized by "low-cost" bone quality estimation and osteoporosis diagnosis, fracture detection, and risk prediction, but also automatized and standardized large-scale data analysis and data-driven imaging biomarker discovery.

View Article and Find Full Text PDF

Purpose: To organize a multi-institute knee MRI segmentation challenge for characterizing the semantic and clinical efficacy of automatic segmentation methods relevant for monitoring osteoarthritis progression.

Materials And Methods: A dataset partition consisting of three-dimensional knee MRI from 88 retrospective patients at two time points (baseline and 1-year follow-up) with ground truth articular (femoral, tibial, and patellar) cartilage and meniscus segmentations was standardized. Challenge submissions and a majority-vote ensemble were evaluated against ground truth segmentations using Dice score, average symmetric surface distance, volumetric overlap error, and coefficient of variation on a holdout test set.

View Article and Find Full Text PDF

Many studies have validated cartilage thickness as a biomarker for knee osteoarthritis (OA); however, few studies investigate beyond cross-sectional observations or comparisons across two timepoints. By characterizing the trajectory of cartilage thickness changes over 8 years in healthy individuals from the OA initiative data set, this study discovers associations between the dynamics of cartilage changes and OA incidence. A fully automated cartilage segmentation and thickness measurement method were developed and validated against manual measurements: mean absolute error = 0.

View Article and Find Full Text PDF

Purpose: To evaluate the diagnostic utility of two convolutional neural networks (CNNs) for severity staging of anterior cruciate ligament (ACL) injuries.

Materials And Methods: In this retrospective study, 1243 knee MR images (1008 intact, 18 partially torn, 77 fully torn, and 140 reconstructed ACLs) from 224 patients (mean age, 47 years ± 14 [standard deviation]; 54% women) were analyzed. The MRI examinations were performed between 2011 and 2014.

View Article and Find Full Text PDF

While substantial work has been done to understand the relationships between cartilage T relaxation times and osteoarthritis (OA), diagnostic and prognostic abilities of T on a large population yet need to be established. Using 3921 manually annotated 2D multi-slice multi-echo spin-echo magnetic resonance imaging volume, a segmentation model for automatic knee cartilage segmentation was built and evaluated. The optimized model was then used to calculate T values on the entire osteoarthritis initiative (OAI) dataset composed of longitudinal acquisitions of 4796 unique patients, 25 729 magnetic resonance imaging studies in total.

View Article and Find Full Text PDF

Purpose: To learn bone shape features from spherical bone map of knee MRI images using established convolutional neural networks (CNN) and use these features to diagnose and predict osteoarthritis (OA).

Methods: A bone segmentation model was trained on 25 manually annotated 3D MRI volumes to segment the femur, tibia, and patella from 47 078 3D MRI volumes. Each bone segmentation was converted to a 3D point cloud and transformed into spherical coordinates.

View Article and Find Full Text PDF

Deep learning is one of the most exciting new areas in medical imaging. This review article provides a summary of the current clinical applications of deep learning for lesion detection, progression, and prediction of musculoskeletal disease on radiographs, computed tomography (CT), magnetic resonance imaging (MRI), and nuclear medicine. Deep-learning methods have shown success for estimating pediatric bone age, detecting fractures, and assessing the severity of osteoarthritis on radiographs.

View Article and Find Full Text PDF

This paper presents a novel two-stage vessel segmentation framework applied to retinal fundus images. In the first stage a convolutional neural network (CNN) is used to correlate an image patch with a corresponding groundtruth reduced using Totally Random Trees Embedding. In the second stage training patches are forward propagated through CNN to create a visual codebook.

View Article and Find Full Text PDF

Diabetic retinopathy (DR) is an asymptotic complication of diabetes and the leading cause of preventable blindness in the working-age population. Early detection and treatment of DR is critical to avoid vision loss. Exudates are one of the earliest and most prevalent signs of DR.

View Article and Find Full Text PDF

Backround And Objectives: Diabetic retinopathy is a microvascular complication of diabetes that can lead to sight loss if treated not early enough. Microaneurysms are the earliest clinical signs of diabetic retinopathy. This paper presents an automatic method for detecting microaneurysms in fundus photographies.

View Article and Find Full Text PDF

This paper introduces the use of fluid-dynamic modeling to determine the connectivity of overlapping venous and arterial vessels in fundus images. Analysis of the retinal vascular network may provide information related to systemic and local disorders. However, the automated identification of the vascular trees in retinal images is a challenging task due to the low signal-to-noise ratio, nonuniform illumination and the fact that fundus photography is a projection on to the imaging plane of three-dimensional retinal tissue.

View Article and Find Full Text PDF

Aims/hypothesis: Diabetic retinopathy is characterised by morphological lesions related to disturbances in retinal blood flow. It has previously been shown that the early development of retinal lesions temporal to the fovea may predict the development of treatment-requiring diabetic maculopathy. The aim of this study was to map accurately the area where lesions could predict progression to vision-threatening retinopathy.

View Article and Find Full Text PDF

This paper presents a novel tool that allows a user to reconstruct the retinal vascular network from fundus images. The retinal vasculature consists of trees of arteries and veins. Common segmentation algorithms are not able to completely segment out the blood vessels in fundus images.

View Article and Find Full Text PDF