Effects of Consensus Training on the Reliability of Auditory Perceptual Ratings of Voice Quality

Research output: Contribution to journalJournal articleResearchpeer-review

Jenny Iwarsson, Niels Reinholt Petersen

Objectives/Hypothesis: This study investigates the effect of consensus training of listeners on intrarater and interrater reliability and agreement of perceptual voice analysis. The use of such training, including a reference voice sample, could be assumed to make the internal standards held in memory common and more robust, which is of great importance to reduce the variability of auditory perceptual ratings.
Study Design: A prospective design with testing before and after training.
Methods: Thirteen students of audiologopedics served as listening subjects. The ratings were made using a multidimensional protocol with four-point equal-appearing interval scales. The stimuli consisted of text reading by authentic
dysphonic patients. The consensus training for each perceptual voice parameter included (1) definition, (2) underlying physiology, (3) presentation of carefully selected sound examples representing the parameter in three different grades
followed by group discussions of perceived characteristics, and (4) practical exercises including imitation to make use of the listeners’ proprioception.
Results: Intrarater reliability and agreement showed a marked improvement for intermittent aphonia but not for vocal fry. Interrater reliability was high for most parameters before training with a slight increase after training. Interrater
agreement showed marked increases for most voice quality parameters as a result of the training.
Conclusion: The results support the recommendation of specific consensus training, including use of a reference voice sample material, to calibrate, equalize, and stabilize the internal standards held in memory by the listeners.
Original languageEnglish
JournalJournal of Voice
Volume26
Issue number3
Pages (from-to)304-312
ISSN0892-1997
Publication statusPublished - 2012

ID: 38304705