AI Article Synopsis

  • - Despite advancements in arbitrary image style transfer (AST), inconsistent evaluation methods make it difficult to compare different approaches effectively.
  • - The study introduces a multi-granularity assessment system that uses both objective metrics and subjective feedback to evaluate AST methods more reliably.
  • - By analyzing various AST techniques like CNN, flow, transformer, and diffusion-based methods, this research enhances evaluation standards, helping researchers make better comparisons and foster innovation in the field.

Article Abstract

Despite the remarkable process in the field of arbitrary image style transfer (AST), inconsistent evaluation continues to plague style transfer research. Existing methods often suffer from limited objective evaluation and inconsistent subjective feedback, hindering reliable comparisons among AST variants. In this study, we propose a multi-granularity assessment system that combines standardized objective and subjective evaluations. We collect a fine-grained dataset considering a range of image contexts such as different scenes, object complexities, and rich parsing information from multiple sources. Objective and subjective studies are conducted using the collected dataset. Specifically, we innovate on traditional subjective studies by developing an online evaluation system utilizing a combination of point-wise, pair-wise, and group-wise questionnaires. Finally, we bridge the gap between objective and subjective evaluations by examining the consistency between the results from the two studies. We experimentally evaluate CNN-based, flow-based, transformer-based, and diffusion-based AST methods by the proposed multi-granularity assessment system, which lays the foundation for a reliable and robust evaluation. Providing standardized measures, objective data, and detailed subjective feedback empowers researchers to make informed comparisons and drive innovation in this rapidly evolving field. Finally, for the collected dataset and our online evaluation system, please see http://ivc.ia.ac.cn.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2024.3466964DOI Listing

Publication Analysis

Top Keywords

style transfer
12
objective subjective
12
arbitrary image
8
image style
8
subjective feedback
8
multi-granularity assessment
8
assessment system
8
subjective evaluations
8
subjective studies
8
collected dataset
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!