Abstract
Introduction: The use of commercially available automatic speech recognition (ASR) software is challenged when dysarthria accompanies a physical disability. To overcome this issue, a mobile and personal speech assistant (mPASS) platform was developed, using a speaker-dependent ASR software. Objective: The aim of this study was to evaluate the performance of the proposed platform and to compare mPASS recognition accuracy to a commercial speaker-independent ASR software. In addition, secondary aims were to investigate the relationship between severity of dysarthria and accuracy and to explore people with dysarthria perceptions on the proposed platform. Methods: Fifteen individuals with dysarthric speech and 20 individuals with nondysarthric speech recorded 24 words and 5 sentences in a clinical environment. Differences in recognition accuracy between the two systems were evaluated. In addition, mPASS usability was assessed with a technology acceptance model (TAM) questionnaire. Results: In both groups, mean accuracy rates were significantly higher with mPASS compared to the commercial ASR for words and for sentences. mPASS reached good levels of usefulness and ease of use according to the TAM questionnaire. Conclusions: Practical applicability of this technology is realistic: the mPASS platform is accurate, and it could be easily used by individuals with dysarthria.
References
1.
Derosier
R
, Farber
RS
. Speech recognition software as an assistive device: a pilot study of user satisfaction and psychosocial impact
. Work
. 2005
;25
(2
):125
–34
.
[PubMed]
1051-98152.
Koester
HH
. Usage, performance, and satisfaction outcomes for experienced users of automatic speech recognition
. J Rehabil Res Dev
. 2004
Sep
;41
(5
):739
–54
.
[PubMed]
0748-77113.
Kim
M
, Kim
Y
, Yoo
J
, Wang
J
, Kim
H
. Regularized Speaker Adaptation of KL-HMM for Dysarthric Speech Recognition
. IEEE Trans Neural Syst Rehabil Eng
. 2017
Sep
;25
(9
):1581
–91
.
[PubMed]
1534-43204.
Enderby
PM
, Emerson
J
. Does speech and language therapy work? A review of the literature
. London
: Whurr Publishers
; 1995
.5.
Kim
H
, Hasegawa-Johnson
M
, Perlman
A
. Vowel contrast and speech intelligibility in dysarthria
. Folia Phoniatr Logop
. 2011
;63
(4
):187
–94
.
[PubMed]
1021-77626.
Rong
P
, Yunusova
Y
, Wang
J
, Zinman
L
, Pattee
GL
, Berry
JD
, et al. Predicting Speech Intelligibility Decline in Amyotrophic Lateral Sclerosis Based on the Deterioration of Individual Speech Subsystems
. PLoS One
. 2016
May
;11
(5
):e0154971
.
[PubMed]
1932-62037.
Rudzicz
F.
Using articulatory likelihoods in the recognition of dysarthric speech.
Speech Communication. 2012
2012/03/01/;54(3):430-44. 8.
Muhammad
G
, Mesallam
TA
, Malki
KH
, Farahat
M
, Alsulaiman
M
, Bukhari
M
. Formant analysis in dysphonic patients and automatic Arabic digit speech recognition
. Biomed Eng Online
. 2011
May
;10
(1
):41
.
[PubMed]
1475-925X9.
Rosen
K
, Yampolsky
S
. Automatic speech recognition and a review of its functioning with dysarthric speech
. Augment Altern Commun
. 2000
;16
(1
):48
–60
. 0743-461810.
Young
V
, Mihailidis
A
. Difficulties in automatic speech recognition of dysarthric speakers and implications for speech-based applications used by the elderly: a literature review
. Assist Technol
. 2010
;22
(2
):99
–112
.
[PubMed]
1040-043511.
Hamidi
F
, Baljko
M
, Livingston
N
, Spalteholz
L
. CanSpeak: a customizable speech interface for people with dysarthric speech.
International Conference on Computers for Handicapped Persons: Springer
; 2010
. p. 605
-12
. 12.
Fager
SK
, Beukelman
DR
, Jakobs
T
, Hosom
JP
. Evaluation of a speech recognition prototype for speakers with moderate and severe dysarthria: a preliminary report
. Augment Altern Commun
. 2010
Dec
;26
(4
):267
–77
.
[PubMed]
0743-461813.
Hawley
MS
, Enderby
P
, Green
P
, Cunningham
S
, Brownsell
S
, Carmichael
J
, et al. A speech-controlled environmental control system for people with severe dysarthria
. Med Eng Phys
. 2007
Jun
;29
(5
):586
–93
.
[PubMed]
1350-453314.
Hawley
MS
, Cunningham
SP
, Green
PD
, Enderby
P
, Palmer
R
, Sehgal
S
, et al. A voice-input voice-output communication aid for people with severe speech impairment
. IEEE Trans Neural Syst Rehabil Eng
. 2013
Jan
;21
(1
):23
–31
.
[PubMed]
1534-432015.
Christensen
H
, Aniol
M
, Bell
P
, Green
PD
, Hain
T
, King
S
, et al. Combining in-domain and out-of-domain speech data for automatic recognition of disordered speech
. INTERSPEECH
; 2013
. pp. 3642
–5
.16.
Cavalcante
AB
, Lorens
L
. Use case: a mobile speech assistant for people with speech disorders.
Proceedings of the 7th Language & Technology Conference
. 2015
. p. 192
-97
.17.
Cavalcante
A
, Grajzer
M.
Proof-of-concept Evaluation of the Mobile and Personal Speech Assistant for the Recognition of Disordered Speech.
International Journal on Advances in Intelligent Systems. 2016
12/01;9:589.18.
Cavalcante
AB
, Grajzer
M
. Mobile and Personal Speech Assistant for the Recognition of Disordered Speech.
Proceedings of the Second International Conference on Smart Portable, Wearable, Implantable and Disability-oriented Devices and Systems (SPWID 2016)
. 2016
. p. 6
-10
.19.
Calvo
I
. Tropea, Scialla, Cavalcante AB, Grajzer M, Gilardone M, et al. An automatic speech recognition platform for dysarthric speech: assessment of accuracy. Proceedings of the Sixth National Conference on Bioengeenering, (GNB 2018). 2018
.20.
21.
Fussi
F
, Cantagallo
A
. Profilo di valutazione della disartria
. Torino
: Omega Edizioni
; 1999
.22.
Raghavendra
P
, Rosengren
E
, Hunnicutt
S
. An investigation of different degrees of dysarthric speech as input to speaker-adaptive and speaker-dependent recognition systems
. Augment Altern Commun
. 2001
;17
(4
):265
–75
. 0743-461823.
Havstam
C
, Buchholz
M
, Hartelius
L
. Speech recognition and dysarthria: a single subject study of two individuals with profound impairment of speech and motor control
. Logoped Phoniatr Vocol
. 2003
;28
(2
):81
–90
.
[PubMed]
1401-543924.
Davis
FD
. Perceived usefulness, perceived ease of use, and user acceptance of information technology
. Manage Inf Syst Q
. 1989
;13
(3
):319
–40
. 0276-778325.
Chuttur
MY
. Overview of the technology acceptance model: Origins, developments and future directions. Working Papers on Information Systems. 2009
;9(37):9-37.26.
Hux
K
, Rankin-Erickson
J
, Manasse
N
, Lauritzen
E
. Accuracy of three speech recognition systems: case study of dysarthric speech
. Augment Altern Commun
. 2000
;16
(3
):186
–96
. 0743-461827.
Fager
SK
, Burnfield
JM
. Speech Recognition for Environmental Control: Effect of Microphone Type, Dysarthria, and Severity on Recognition Results
. Assist Technol
. 2015
;27
(4
):199
–207
.
[PubMed]
1040-043528.
Barreto
SD
, Ortiz
KZ
. Speech Intelligibility in Dysarthrias: Influence of Utterance Length
. Folia Phoniatr Logop
. 2019
Apr
;•••
:1
–9
.
[PubMed]
1021-776229.
Schalling
E
, Johansson
K
, Hartelius
L
. Speech and Communication Changes Reported by People with Parkinson’s Disease
. Folia Phoniatr Logop
. 2017
;69
(3
):131
–41
.
[PubMed]
1021-776230.
Hanson
EK
, Fager
SK
. Communication supports for people with motor speech disorders
. Top Lang Disord
. 2017
;37
(4
):375
–88
. 0271-829431.
Weismer
G
, Jeng
JY
, Laures
JS
, Kent
RD
, Kent
JF
. Acoustic and intelligibility characteristics of sentence production in neurogenic speech disorders
. Folia Phoniatr Logop
. 2001
Jan-Feb
;53
(1
):1
–18
.
[PubMed]
1021-776232.
Kotler
AL
, Thomas-Stonell
N
. Effects of speech training on the accuracy of speech recognition for an individual with a speech impairment
. Augment Altern Commun
. 1997
;13
(2
):71
–80
. 0743-461833.
Ferrier
L
, Shane
H
, Ballard
H
, Carpenter
T
, Benoit
A
. Dysarthric speakers’ intelligibility and speech characteristics in relation to computer speech recognition
. Augment Altern Commun
. 1995
;11
(3
):165
–75
. 0743-461834.
Patel
R
, Hustad
KC
, Connaghan
KP
, Furr
W
. Relationship Between Prosody and Intelligibility in Children with Dysarthria
. J Med Speech Lang Pathol
. 2012
Dec
;20
(4
):17
.
[PubMed]
1065-143835.
Lee
J
, Bell
M
. Articulatory Range of Movement in Individuals With Dysarthria Secondary to Amyotrophic Lateral Sclerosis
. Am J Speech Lang Pathol
. 2018
Aug
;27
(3
):996
–1009
.
[PubMed]
1058-036036.
Bunton
K
, Kent
RD
, Duffy
JR
, Rosenbek
JC
, Kent
JF
. Listener agreement for auditory-perceptual ratings of dysarthria
. J Speech Lang Hear Res
. 2007
Dec
;50
(6
):1481
–95
.
[PubMed]
1092-438837.
Connaghan
KP
, Patel
R
. The Impact of Contrastive Stress on Vowel Acoustics and Intelligibility in Dysarthria
. J Speech Lang Hear Res
. 2017
Jan
;60
(1
):38
–50
.
[PubMed]
1092-438838.
Hustad
KC
. Estimating the intelligibility of speakers with dysarthria
. Folia Phoniatr Logop
. 2006
;58
(3
):217
–28
.
[PubMed]
1021-776239.
Wang
YT
, Kent
RD
, Kent
JF
, Duffy
JR
, Thomas
JE
. Acoustic analysis of voice in dysarthria following stroke
. Clin Linguist Phon
. 2009
May
;23
(5
):335
–47
.
[PubMed]
0269-9206© 2020 S. Karger AG, Basel
2020
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.
