AI Article Synopsis

Article Abstract

Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We remove the requirement of base class labels and learn generalizable embeddings via Unsupervised Meta-Learning (UML). Specifically, episodes of tasks are constructed with data augmentations from unlabeled base classes during meta-training, and we apply embedding-based classifiers to novel tasks with labeled few-shot examples during meta-test. We observe two elements play important roles in UML, i.e., the way to sample tasks and measure similarities between instances. Thus we obtain a strong baseline with two simple modifications - a sufficient sampling strategy constructing multiple tasks per episode efficiently together with a semi-normalized similarity. We then take advantage of the characteristics of tasks from two directions to get further improvements. First, synthesized confusing instances are incorporated to help extract more discriminative embeddings. Second, we utilize an additional task-specific embedding transformation as an auxiliary component during meta-training to promote the generalization ability of the pre-adapted embeddings. Experiments on few-shot learning benchmarks verify that our approaches outperform previous UML methods and achieve comparable or even better performance than its supervised variants.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TPAMI.2022.3179368DOI Listing

Publication Analysis

Top Keywords

unsupervised meta-learning
8
base classes
8
tasks
7
revisiting unsupervised
4
meta-learning characteristics
4
few-shot
4
characteristics few-shot
4
few-shot tasks
4
tasks meta-learning
4
meta-learning practical
4

Similar Publications

Intrinsic dynamics within the brain can accelerate learning by providing a prior scaffolding for dynamics aligned with task objectives. Such intrinsic dynamics should self-organize and self-sustain in the face of fluctuating inputs and biological noise, including synaptic turnover and cell death. An example of such dynamics is the formation of sequences, a ubiquitous motif in neural activity.

View Article and Find Full Text PDF

Crowd Counting Using Meta-Test-Time Adaptation.

Int J Neural Syst

November 2024

Department of Computer Science and Software Engineering, Concordia University, Montreal, QC H3H 2L9, Canada.

Article Synopsis
  • Machine learning algorithms are used for counting people in crowds, and test-time adaptation methods help models adjust to specific conditions during testing by altering model parameters and using additional data augmentation.
  • Unlike traditional methods that require extensive unannotated data for each new target domain, the proposed CrowdTTA approach combines test-time adaptation with meta-learning for better adaptability in unknown conditions.
  • CrowdTTA generates pseudo labels using uncertainty from a dropout layer, facilitating dual-level optimization which improves model performance and accuracy in counting people under various crowd densities and scales during testing.
View Article and Find Full Text PDF

In practical engineering, obtaining labeled high-quality fault samples poses challenges. Conventional fault diagnosis methods based on deep learning struggle to discern the underlying causes of mechanical faults from a fine-grained perspective, due to the scarcity of annotated data. To tackle those issue, we propose a novel semi-supervised Gaussian Mixed Variational Autoencoder method, SeGMVAE, aimed at acquiring unsupervised representations that can be transferred across fine-grained fault diagnostic tasks, enabling the identification of previously unseen faults using only the small number of labeled samples.

View Article and Find Full Text PDF

Meta-learning based blind image super-resolution approach to different degradations.

Neural Netw

October 2024

Department of Electrical and Electronic Engineering, Imperial College London, London, SW72AZ, UK. Electronic address:

Although recent studies on blind single image super-resolution (SISR) have achieved significant success, most of them typically require supervised training on synthetic low resolution (LR)-high resolution (HR) paired images. This leads to re-training necessity for different degradations and restricted applications in real-world scenarios with unfavorable inputs. In this paper, we propose an unsupervised blind SISR method with input underlying different degradations, named different degradations blind super-resolution (DDSR).

View Article and Find Full Text PDF

Learning based approaches have witnessed great successes in blind single image super-resolution (SISR) tasks, however, handcrafted kernel priors and learning based kernel priors are typically required. In this paper, we propose a meta-learning and Markov Chain Monte Carlo (MCMC) based SISR approach to learn kernel priors from organized randomness. In concrete, a lightweight network is adopted as kernel generator, and is optimized via learning from the MCMC simulation on random Gaussian distributions.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!