Publications by authors named "Abdourrahmane M Atto"

The article proposes a plural learning framework combining the ingredients found in a tribunal for the derivation of a more generalized artificial intelligence (GAI) when starting from a specialized set of convolutional neural networks (CNNs). This framework involves at least two different training stages called, respectively, specialization and generalization. In the specialization stage, any CNN considered in a given set learns to predict independently of other elements of the set.

View Article and Find Full Text PDF

The paper proposes a new class of nonlinear operators and a dual learning paradigm where optimization jointly concerns both linear convolutional weights and the parameters of these nonlinear operators. The nonlinear class proposed to perform a rich functional representation is composed by functions called rectified parametric sigmoid units. This class is constructed to benefit from the advantages of both sigmoid and rectified linear unit functions, while rejecting their respective drawbacks.

View Article and Find Full Text PDF
Altruistic Collaborative Learning.

IEEE Trans Neural Netw Learn Syst

February 2024

This article proposes a new learning paradigm based on the concept of concordant gradients for ensemble learning strategies. In this paradigm, learners update their weights if and only if the gradients of their cost functions are mutually concordant in a sense given by paper. The objective of the proposed concordant optimization framework is robustness against uncertainties by postponing to a later epoch, the consideration of examples associated with discordant directions during a training phase.

View Article and Find Full Text PDF

This brief addresses understandability of modern machine learning networks with respect to the statistical properties of their convolution layers. It proposes a set of tools for categorizing a convolution layer in terms of kernel property (meanlet, differencelet, or distrotlet) or kernel sequence property (frame spectra and intralayer correlation matrix). These tools are expected to be relevant for determining the generalization capabilities of a convolutional neural network.

View Article and Find Full Text PDF

This brief derives a 2-D spectrum estimator from some recent results on the statistical properties of wavelet packet coefficients of random processes. It provides an analysis of the bias of this estimator with respect to the wavelet order. This brief also discusses the performance of this wavelet-based estimator, in comparison with the conventional 2-D Fourier-based spectrum estimator on texture analysis and content-based image retrieval.

View Article and Find Full Text PDF