AI Article Synopsis

  • Neural networks used in important decision-making need to explain their predictions clearly and identify any unusual cases that require expert review.
  • The proposed method combines explanation generation and outlier detection through prototype-based student networks, which offer example-based insights using key training set cases.
  • The study demonstrates that these networks not only enhance explanation quality and find outliers effectively but also maintain high classification accuracy compared to traditional methods.

Article Abstract

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is important to flag potential outliers for in-depth verification by domain experts. In this work we propose to unify two differing aspects of explainability with outlier detection. We argue for a broader adoption of prototype-based student networks capable of providing an example-based explanation for their prediction and at the same time identify regions of similarity between the predicted sample and the examples. The examples are real prototypical cases sampled from the training set via a novel iterative prototype replacement algorithm. Furthermore, we propose to use the prototype similarity scores for identifying outliers. We compare performance in terms of the classification, explanation quality and outlier detection of our proposed network with baselines. We show that our prototype-based networks extending beyond similarity kernels deliver meaningful explanations and promising outlier detection results without compromising classification accuracy.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TIP.2021.3127847DOI Listing

Publication Analysis

Top Keywords

outlier detection
16
example-based explanation
8
scalable unified
4
unified example-based
4
outlier
4
explanation outlier
4
detection
4
detection neural
4
neural networks
4
networks employed
4

Similar Publications

A Comprehensive Survey on the Integrity of Localization Systems.

Sensors (Basel)

January 2025

Inria-ASTRA Team, 48 Rue Barrault, 75013 Paris, France.

This survey extends and refines the existing definitions of integrity and protection level in localization systems (localization as a broad term, i.e., not limited to GNSS-based localization).

View Article and Find Full Text PDF

Breast imaging readers' performance in the PERFORMS test-set based assessment scheme within the MyPeBS international randomised study.

Eur J Radiol

January 2025

Translational Medical Sciences, School of Medicine, University of Nottingham, City Hospital Campus, Hucknall Road, Nottingham NG5 1PB, United Kingdom.

Purpose: A survey conducted by the European Society of Breast Imaging (EUSOBI) in 2023 revealed significant variations in Quality Assurance (QA) practices across Europe. The UK encourages regular performance monitoring for screen readers. This study aimed to assess the variability in diagnostic performance among readers participating in a wider prospective randomised trial across multiple countries.

View Article and Find Full Text PDF

Although it is not a new illness and has been around since the previous century, monkeypox later resurgence is fraught with difficulties. This study presents a novel approach of diagnosing monkeypox using artificial intelligence, which is called Effective Monkeypox Diagnosis Strategy (EMDS). The proposed EMDS is established through two sequential stages, namely; (i) Pre-Processing Phase (PP) and (ii) Monkeypox Diagnosing phase (MDP).

View Article and Find Full Text PDF

Geometric Feature Characterization of Apple Trees from 3D LiDAR Point Cloud Data.

J Imaging

December 2024

Department of Agricultural Machinery Engineering, Graduate School, Chungnam National University, Daejeon 34134, Republic of Korea.

The geometric feature characterization of fruit trees plays a role in effective management in orchards. LiDAR (light detection and ranging) technology for object detection enables the rapid and precise evaluation of geometric features. This study aimed to quantify the height, canopy volume, tree spacing, and row spacing in an apple orchard using a three-dimensional (3D) LiDAR sensor.

View Article and Find Full Text PDF

The voltage is one of limited reliable information for battery management system, and the faults of voltage sampling will result in adverse effects and lead to potential risks for operation, which emphasize the importance for investigating the failure modes of voltage sampling and diagnosis algorithm. In this article, a knowledge-data driven sampling diagnosis algorithm is established and an online intelligent diagnosis algorithm is proposed accordingly based on outlier detection with fuzzy entropy. The fault diagnosis algorithm is established and evaluated under positive exploitation, where the knowledge-base of failure mode based on equivalent simulating models is firstly constructed.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!