The use of residual analysis to improve the error rate accuracy of machine translation.

Sci Rep

Science and Research Centre, University of Pardubice, Studentská 84, 532 10, Pardubice, Czech Republic.

Published: April 2024

The aim of the study is to compare two different approaches to machine translation-statistical and neural-using automatic MT metrics of error rate and residuals. We examined four available online MT systems (statistical Google Translate, neural Google Translate, and two European commission's MT tools-statistical mt@ec and neural eTranslation) through their products (MT outputs). We propose using residual analysis to improve the accuracy of machine translation error rate. Residuals represent a new approach to comparing the quality of statistical and neural MT outputs. The study provides new insights into evaluating machine translation quality from English and German into Slovak through automatic error rate metrics. In the category of prediction and syntactic-semantic correlativeness, statistical MT showed a significantly higher error rate than neural MT. Conversely, in the category of lexical semantics, neural MT showed a significantly higher error rate than statistical MT. The results indicate that relying solely on the reference when determining MT quality is insufficient. However, when combined with residuals, it offers a more objective view of MT quality and facilitates the comparison of statistical MT and neural MT.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11039693PMC
http://dx.doi.org/10.1038/s41598-024-59524-3DOI Listing

Publication Analysis

Top Keywords

error rate
24
machine translation
12
residual analysis
8
analysis improve
8
accuracy machine
8
rate residuals
8
google translate
8
statistical neural
8
higher error
8
error
6

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!