Reliability and Validity of GRBASzero in Clinical Environments.

Purpose: This study aimed to evaluate the reliability and validity of GRBASzero in a real clinical setting.

Methods: The reliability and validity of GRBASzero were assessed using two independent datasets. Dataset 1 included 283 outpatients who underwent both GRBASzero assessment and human expert evaluation. Dataset 2 from the Perceptual Voice Qualities Database comprised 287 voice samples that underwent evaluation by GRBASzero and were subsequently compared with GRBAS (Grade, Roughness, Breathiness, Asthenicity, Strain) ratings provided by human experts. The reliability of GRBASzero was assessed using Fleiss Kappa, while the validity of GRBASzero was examined using the intraclass correlation coefficient.

Results: In dataset 1, the test-retest reliability of GRBASzero was poor, with the consistency of features A and S approaching random allocation. Consistency analysis with human experts showed a poor agreement for all features except for B. In dataset 2, there was also a poor agreement between GRBASzero and human experts.

Conclusion: The reliability and validity of GRBASzero in a real clinical environment are poor and do not meet the requirements for clinical testing, indicating the need for further optimization and improvement.