Aim: To explore a novel and efficient way of calculating transcription reliability of connected speech data using the concept of near functional equivalence. Using this approach, differences between two transcribed phonemes that are nearly phonetically equivalent are disregarded if both reflect two plausible and acceptable pronunciations for the word produced. Method: The study used transcriptions of connected speech samples from 63 five-year-olds who participated in a large-scale population study. Each recording was phonetically transcribed by two speech and language therapists. Two independent researchers then examined agreement -between the two sets of transcripts, marking differences in vowels, consonants and diacritics and identifying segments which represented near functional equivalence. Results: Overall percentage agreement between the transcripts was 77%. One quarter of the differences between the two transcripts were identified as showing near functional equivalence. When this category was excluded, the transcripts showed 82% reliability. Conclusions: This study demonstrates the issues to consider when calculating transcription reliability. Other methods are often time-intensive and may highlight differences between transcribed units which are audibly very similar and would be negligible in ordinary conversation. Inclusion of the concept of “near functional equivalence” can result in higher reliability scores for transcription, without loss of rigour.

1.
Müller
N
,
Damico
JS
.
A transcription toolkit: theoretical and clinical considerations
.
Clin Linguist Phon
.
2002
Jul-Aug
;
16
(
5
):
299
316
.
[PubMed]
0269-9206
2.
Ball
M
,
Howard
S
,
Muller
N
,
Granese
A
. Data processing: Transcriptional and impressionistic methods. In:
Muller
N
,
Ball
M
, editors
.
Research Methods in clinical Linguistics and Phonetics
.
Chichester
:
Wiley-Blackwell
;
2013
. pp.
177
94
.
3.
Ball
M
,
Müller
N
,
Klopfenstein
M
,
Rutter
B
.
The importance of narrow phonetic transcription for highly unintelligible speech: some examples
.
Logoped Phoniatr Vocol
.
2009
;
34
(
2
):
84
90
.
[PubMed]
1401-5439
4.
Cucchiarini
C
.
Assessing transcription agreement: methodological aspects
.
Clin Linguist Phon
.
1996
;
10
(
2
):
131
55
. 0269-9206
5.
Rutter
B
,
Cunningham
S
.
The recording of audio and video data. Guide to research methods
.
Clin Linguist Phon
.
2013
;
•••
:
160
76
.0269-9206
6.
Shriberg
LD
,
Lof
G
.
Reliability studies in broad and narrow phonetic transcription
.
Clin Linguist Phon
.
1991
;
5
(
3
):
225
79
. 0269-9206
7.
Sescleifer
AM
,
Francoisse
CA
,
Lin
AY
.
Systematic review: online crowdsourcing to assess perceptual speech outcomes
.
J Surg Res
.
2018
Dec
;
232
:
351
64
.
[PubMed]
0022-4804
8.
McAllister Byun
T
,
Halpin
PF
,
Szeredi
D
.
Online crowdsourcing for efficient rating of speech: a validation study
.
J Commun Disord
.
2015
Jan-Feb
;
53
:
70
83
.
[PubMed]
0021-9924
9.
Wren
Y
,
Roulstone
S
,
Miller
LL
,
Emond
A
,
Peters
T
.
The prevalence, characteristics and risk factors of persistent speech disorder
.
J Speech Lang Hear Res
.
2016
;
59
:
647
73
.
[PubMed]
1092-4388
10.
Shriberg
LD
,
Tomblin
JB
,
McSweeny
JL
.
Prevalence of speech delay in 6-year-old children and comorbidity with language impairment
.
J Speech Lang Hear Res
.
1999
Dec
;
42
(
6
):
1461
81
.
[PubMed]
1092-4388
11.
Ball
MJ
,
Rahilly
J
.
Transcribing disordered speech: the segmental and prosodic layers
.
Clin Linguist Phon
.
2002
Jul-Aug
;
16
(
5
):
329
44
.
[PubMed]
0269-9206
12.
Ferrier
LJ
,
Johnston
JJ
,
Bashir
AS
.
A longitudinal study of the babbling and phonological development of a child with hypoglossia
.
Clin Linguist Phon
.
1991
;
3
(
3
):
187
206
. 0269-9206
13.
Otomo
K
,
Stoel-Gammon
C
.
The acquisition of unrounded vowels in English
.
J Speech Hear Res
.
1992
Jun
;
35
(
3
):
604
16
.
[PubMed]
0022-4685
14.
Pye
C
,
Wilcox
KA
,
Siren
KA
.
Refining transcriptions: the significance of transcriber ‘errors’
.
J Child Lang
.
1988
Feb
;
15
(
1
):
17
37
.
[PubMed]
0305-0009
15.
Smit
AB
,
Brumbaugh
KM
,
Weltsch
B
,
Hilgers
M
.
Treatment of phonological disorder: A feasibility study with focus on outcome measures
.
Am J Speech Lang Pathol
.
2018
May
;
27
(
2
):
536
52
.
[PubMed]
1058-0360
16.
Viereggew
H
. Basic aspects of phonetic segmental transcription. In:
Almeida
A
,
Braun
A
, editors
.
Problerne der phonetischen Transkription
.
Wiesbaden
:
Franz Steiner Verlag
;
1987
.
17.
Shriberg
LD
,
Kwiatkowski
J
,
Hoffmann
K
.
A procedure for phonetic transcription by consensus
.
J Speech Hear Res
.
1984
Sep
;
27
(
3
):
456
65
.
[PubMed]
0022-4685
18.
Shriberg
LD
,
Kent
RD
.
Clinical phonetics
. 3rd ed.
Denver
:
Pearson
;
2002
. pp.
372
3
.
19.
Kluender
L
,
Keifte
M
. Speech perception within a biologically realistic information-theoretic framework. In:
Gernsbacher
A
,
Traxler
M
, editors
.
Handbook of psycholinguistics
. 2nd ed.
London
:
Elsevier
;
2006
. pp.
153
99
.
20.
Howard
S
,
Wells
B
,
Local
J
. Connected speech. In:
Ball
MJ
,
Perkins
MR
,
Muller
N
,
Howard
S
, editors
.
The handbook of clinical linguistics
.
Oxford
:
Blackwell
;
2008
. pp.
583
602
.
21.
Howard
S
. Phonetic transcription for speech related to cleft palate. In:
Howard
S
,
Lohmander
A
, editors
.
Cleft Palate Speech Assessment and Intervention
.
Chichester
:
Wiley-Blackwell
;
2011
. pp.
127
42
.
22.
Boyd
A
,
Golding
J
,
Macleod
J
,
Lawlor
DA
,
Fraser
A
,
Henderson
J
, et al.
Cohort Profile: the ‘children of the 90s’—the index offspring of the Avon Longitudinal Study of Parents and Children
.
Int J Epidemiol
.
2013
Feb
;
42
(
1
):
111
27
.
[PubMed]
0300-5771
23.
Fraser
A
,
Macdonald-Wallis
C
,
Tilling
K
,
Boyd
A
,
Golding
J
,
Davey Smith
G
, et al.
Cohort profile: The Avon longitudinal study of parents and children: ALSPAC mothers cohort
.
Int J Epidemiol
.
2013
Feb
;
42
(
1
):
97
110
.
[PubMed]
0300-5771
24.
Paden
EP
,
Novak
MA
,
Beiter
AL
.
Predictors of phonologic inadequacy in young children prone to otitis media
.
J Speech Hear Disord
.
1987
Aug
;
52
(
3
):
232
42
.
[PubMed]
0022-4677
25.
Reynell
J
.
The Reynell Developmental Language Scales
. Revised Edition.
Windsor
:
NFER-Nelson
;
1977
.
26.
Renfrew
CE
. Bus Story Test: A test of narrative speech (4th eds): Chesterfield; Winslow Press Ltd,
1997
.
27.
Byrne
B
,
Fielding-Barnsley
R
.
Recognition of phoneme invariance by beginning readers
.
Read Writ
.
1993
;
5
(
3
):
315
24
. 0922-4777
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.