How Does Alignment Error Affect Automated Pronunciation Scoring in Children's Speech?

Automated goodness of pronunciation scores measure deviation from typical adult speech by first phonetically segmenting speech using forced alignment and then computing phoneme likelihoods. Care must be taken to distinguish between the impact of alignment error (a spurious signal) and true acoustic deviation on the automated score. Using mixed effects modeling, we predict , the difference between pronunciation scores computed using manual alignment ( ) versus computed using automatic forced alignments ( ). Pronunciation deviations and alignment error are both magnified in children's speech and may be influenced by factors such as phoneme position and phoneme type. Our methodology shows that alignment error has a moderate effect on , and other variables have small to no effect. Manual closely matches automatically calculated following cross utterance averaging. Thus, practical comparisons between child speakers should be very comparable across the two methods.