Effects of Consensus Training on the Reliability of Auditory Perceptual Ratings of Voice Quality

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Objectives/Hypothesis: This study investigates the effect of consensus training of listeners on intra- and inter-rater reliability and agreement of perceptual voice analysis. The use of such training including a reference voice sample could be assumed to make the internal standards held in memory common and more robust, which is of great importance in order to reduce the variability of auditory perceptual ratings. Study Design: A prospective design with testing before and after training. Methods: 13 students of audiologopedics served as listening subjects. The ratings were made using a multidimensional protocol with four point equal appearing interval (EAI) scales. The stimuli consisted of text reading by authentic dysphonic patients. The consensus training for each perceptual voice parameter included 1) definition, 2) underlying physiology, 3) presentation of carefully selected sound examples representing the parameter in three different grades followed by group discussions of perceived characteristics and 4) practical exercises including imitation in order to make use of the listeners’ proprioception. Results: Intra-rater reliability and agreement showed a marked improvement on one of the two stimuli included (intermittent aphonia), but not for the other (vocal fry). Inter-rater reliability was high for the majority of the parameters before training with a slight increase after training. Inter-rater agreement showed marked increases for the majority of voice quality parameters as a result of the training. Conclusion: The results support the recommendation of specific consensus training, including use of a reference voice sample material, in order to “calibrate”, equalize and stabilize the internal standards held in memory by the listeners.
Bidragets oversatte titelEffekter av konsensustræning på reliabiliteten i auditive perceptuelle lyttebedømmelser af stemmekvalitet.
TidsskriftJournal of Voice
Udgave nummer3
Sider (fra-til)304-312
StatusUdgivet - 2012


  • Det Humanistiske Fakultet - Voice quality, Auditory perceptual ratings, Consesus training, Internal standards

ID: 38304705