Harnessing Big Data in Amyotrophic Lateral Sclerosis: Machine Learning Applications for Clinical Practice and Pharmaceutical Trials.

The arrival of genotype-specific therapies in amyotrophic lateral sclerosis (ALS) signals the dawn of precision medicine in motor neuron diseases (MNDs). After decades of academic studies in ALS, we are now witnessing tangible clinical advances. An ever increasing number of well-designed descriptive studies have been published in recent years, characterizing typical disease-burden patterns and .

Neural networks with ReLU powers need less depth.

Despite the widespread success of deep learning in various applications, neural network theory has been lagging behind. The choice of the activation function plays a critical role in the expressivity of a neural network but for reasons that are not yet fully understood. While the rectified linear unit (ReLU) is currently one of the most popular activation functions, ReLU squared has only recently been empirically shown to be pivotal in producing consistently superior results for state-of-the-art deep learning tasks (So et al.