Global tests for novelty.

Stat Methods Med Res

1 Department of Mathematics and Statistics, University of Turku, Finland.

Published: August 2017

Outlier detection covers the wide range of methods aiming at identifying observations that are considered unusual. Novelty detection, on the other hand, seeks observations among newly generated test data that are exceptional compared with previously observed training data. In many applications, the general existence of novelty is of more interest than identifying the individual novel observations. For instance, in high-throughput cancer treatment screening experiments, it is meaningful to test whether any new treatment effects are seen compared with existing compounds. Here, we present hypothesis tests for such global level novelty. The problem is approached through a set of very general assumptions, making it innovative in relation to the current literature. We introduce test statistics capable of detecting novelty. They operate on local neighborhoods and their null distribution is obtained by the permutation principle. We show that they are valid and able to find different types of novelty, e.g. location and scale alternatives. The performance of the methods is assessed with simulations and with applications to real data sets.

Download full-text PDF

Source
http://dx.doi.org/10.1177/0962280215591236DOI Listing

Publication Analysis

Top Keywords

novelty
6
global tests
4
tests novelty
4
novelty outlier
4
outlier detection
4
detection covers
4
covers wide
4
wide range
4
range methods
4
methods aiming
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!