KS(conf): A Light-Weight Test if a Multiclass Classifier Operates Outside of Its Specifications.

We study the problem of automatically detecting if a given multi-class classifier operates , i.e. on input data from a different distribution than what it was trained for.