Hypothesis: Net benefit as an objective function during development of machine learning algorithms for medical applications.

Net benefit is the most widely used metric for evaluating the clinical utility of medical prediction models. The approach applies decision analytic theory to weight true and false positives depending on the relative consequences of different decision outcomes. It is plausible that there are at least some machine learning scenarios where optimization of the objective function during model development will not optimize net benefit during model evaluation.