IEEE Trans Neural Netw Learn Syst
June 2024
The existing approaches on continual learning (CL) call for a lot of samples in their training processes. Such approaches are impractical for many real-world problems having limited samples because of the overfitting problem. This article proposes a few-shot CL approach, termed flat-to-wide approach (FLOWER), where a flat-to-wide learning process finding the flat-wide minima is proposed to address the catastrophic forgetting (CF) problem.
View Article and Find Full Text PDFIEEE Trans Neural Netw Learn Syst
October 2023
A cross domain multistream classification is a challenging problem calling for fast domain adaptations to handle different but related streams in never-ending and rapidly changing environments. Notwithstanding that existing multistream classifiers assume no labeled samples in the target stream, they still incur expensive labeling costs since they require fully labeled samples of the source stream. This article aims to attack the problem of extreme label shortage in the cross domain multistream classification problems where only very few labeled samples of the source stream are provided before process runs.
View Article and Find Full Text PDFIEEE Trans Neural Netw Learn Syst
December 2023
A deep clustering network (DCN) is desired for data streams because of its aptitude in extracting natural features thus bypassing the laborious feature engineering step. While automatic construction of deep networks in streaming environments remains an open issue, it is also hindered by the expensive labeling cost of data streams rendering the increasing demand for unsupervised approaches. This article presents an unsupervised approach of DCN construction on the fly via simultaneous deep learning and clustering termed autonomous DCN (ADCN).
View Article and Find Full Text PDFAnnu Int Conf IEEE Eng Med Biol Soc
July 2020
Accurate detection of neuro-psychological disorders such as Attention Deficit Hyperactivity Disorder (ADHD) using resting state functional Magnetic Resonance Imaging (rs-fMRI) is challenging due to high dimensionality of input features, low inter-class separability, small sample size and high intra-class variability. For automatic diagnosis of ADHD and autism, spatial transformation methods have gained significance and have achieved improved classification performance. However, they are not reliable due to lack of generalization in dataset like ADHD with high variance and small sample size.
View Article and Find Full Text PDFAnnu Int Conf IEEE Eng Med Biol Soc
July 2020
The degradation of the subject-independent classification on a brain-computer interface is a challenging issue. One method mostly taken to overcome this problem is by collecting as many subjects as possible and then training the system across all subjects. This article introduces streaming online learning called autonomous deep learning (ADL) to classify five individual fingers based on electroencephalography (EEG) signals to overcome the issue above.
View Article and Find Full Text PDFFinancial time series forecasting is a crucial measure for improving and making more robust financial decisions throughout the world. Noisy data and non-stationarity information are the two key factors in financial time series prediction. This paper proposes twin support vector regression for financial time series prediction to deal with noisy data and nonstationary information.
View Article and Find Full Text PDFExisting methodologies for tool condition monitoring (TCM) still rely on batch approaches which cannot cope with a fast sampling rate of a metal cutting process. Furthermore, they require a retraining process to be completed from scratch when dealing with a new set of machining parameters. This paper presents an online TCM approach based on Parsimonious Ensemble+ (pENsemble+).
View Article and Find Full Text PDFIEEE Trans Cybern
October 2017
Multidocument summarization has gained popularity in many real world applications because vital information can be extracted within a short time. Extractive summarization aims to generate a summary of a document or a set of documents by ranking sentences and the ranking results rely heavily on the quality of sentence features. However, almost all previous algorithms require hand-crafted features for sentence representation.
View Article and Find Full Text PDFExisting extreme learning algorithm have not taken into account four issues: 1) complexity; 2) uncertainty; 3) concept drift; and 4) high dimensionality. A novel incremental type-2 meta-cognitive extreme learning machine (ELM) called evolving type-2 ELM (eT2ELM) is proposed to cope with the four issues in this paper. The eT2ELM presents three main pillars of human meta-cognition: 1) what-to-learn; 2) how-to-learn; and 3) when-to-learn.
View Article and Find Full Text PDFMost of the dynamics in real-world systems are compiled by shifts and drifts, which are uneasy to be overcome by omnipresent neuro-fuzzy systems. Nonetheless, learning in nonstationary environment entails a system owning high degree of flexibility capable of assembling its rule base autonomously according to the degree of nonlinearity contained in the system. In practice, the rule growing and pruning are carried out merely benefiting from a small snapshot of the complete training data to truncate the computational load and memory demand to the low level.
View Article and Find Full Text PDF