Batch normalization is an essential component of all state-of-the-art neural networks architectures. However, since it introduces many practical issues, much recent research has been devoted to designing normalization-free architectures. In this brief, we show that weights initialization is key to train ResNet-like normalization-free networks. In particular, we propose a slight modification to the summation operation of a block output to the skip-connection branch, so that the whole network is correctly initialized. We show that this modified architecture achieves competitive results on CIFAR-10, CIFAR-100 and ImageNet without further regularization nor algorithmic modifications.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1109/TNNLS.2023.3325541 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Deep learning system for the differential diagnosis of oral mucosal lesions through clinical photographic imaging.
J Dent Sci
January 2025
School of Dentistry, College of Medicine, National Cheng Kung University, Tainan, Taiwan.
Background/purpose: Oral mucosal lesions are associated with a variety of pathological conditions. Most deep-learning-based convolutional neural network (CNN) systems for computer-aided diagnosis of oral lesions have typically concentrated on determining limited aspects of differential diagnosis. This study aimed to develop a CNN-based diagnostic model capable of classifying clinical photographs of oral ulcerative and associated lesions into five different diagnoses, thereby assisting clinicians in making accurate differential diagnoses.
View Article and Find Full Text PDFCytoNorm 2.0: A flexible normalization framework for cytometry data without requiring dedicated controls.
Cytometry A
January 2025
Department of Applied Mathematics, Computer Science and Statistics, Ghent University, Ghent, Belgium.
Cytometry is a single cell, high-dimensional, high-throughput technique that is being applied across a range of disciplines. However, many elements alongside the data acquisition process might give rise to technical variation in the dataset, called batch effects. CytoNorm is a normalization algorithm for batch effect removal in cytometry data that was originally published in 2020 and has been applied on a variety of datasets since then.
View Article and Find Full Text PDFFlow chemistry-enabled asymmetric synthesis of cyproterone acetate in a chemo-biocatalytic approach.
Nat Commun
January 2025
Engineering Center of Catalysis and Synthesis for Chiral Molecules, Department of Chemistry, Fudan University, Shanghai, 200433, China.
Flow chemistry has many advantages over batch synthesis of organic small-molecules in terms of environmental compatibility, safety and synthetic efficiency when scale-up is considered. Herein, we report the 10-step chemo-biocatalytic continuous flow asymmetric synthesis of cyproterone acetate (4) in which 10 transformations are combined into a telescoped flow linear sequence from commercially available 4-androstene-3, 17-dione (11). This integrated one-flow synthesis features an engineered 3-ketosteroid-Δ-dehydrogenase (ReM2)-catalyzed Δ-dehydrogenation to form the C1, C2-double bond of A ring, a substrate-controlled Co-catalyzed Mukaiyama hydration of 9 to forge the crucial chiral C17α-OH group of D ring with excellent stereoselectivity, and a rapid flow Corey-Chaykovsky cyclopropanation of 7 to build the cyclopropyl core of A ring.
View Article and Find Full Text PDFSeverity grading of hypertensive retinopathy using hybrid deep learning architecture.
Comput Methods Programs Biomed
January 2025
Regional Institute of Ophthalmology, Indira Gandhi Institute of Medical Sciences, Patna, 800025, Bihar, India.
Background And Objectives: Hypertensive Retinopathy (HR) is a retinal manifestation resulting from persistently elevated blood pressure. Severity grading of HR is essential for patient risk stratification, effective management, progression monitoring, timely intervention, and minimizing the risk of vision impairment. Computer-aided diagnosis and artificial intelligence (AI) systems play vital roles in the diagnosis and grading of HR.
View Article and Find Full Text PDFTechnology for the Quantitative Identification of Dairy Products Based on Raman Spectroscopy, Chemometrics, and Machine Learning.
Molecules
January 2025
Department of Chemistry, Shanghai Key Laboratory of Molecular Catalysis and Innovative Materials, Fudan University, Shanghai 200438, China.
The technologies used for the characterization and quantitative analysis of dairy products based on Raman spectroscopy have developed rapidly in recent years. At the level of spectral data, there are not only traditional Raman spectra but also two-dimensional correlation spectra, which can provide rich compositional and characteristic information about the samples. In terms of spectral preprocessing, there are various methods, such as normalization, wavelet denoising, and feature extraction.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!