- Research article
- Open Access
Correlation between subjective and objective hearing tests after unilateral and bilateral cochlear implantation
BMC Ear, Nose and Throat Disorders volume 17, Article number: 10 (2017)
There are many methods for assessing hearing performance after cochlear implantation. Standard evaluations often encompass objective hearing tests only, while patients’ subjective experiences gain importance in today’s healthcare. The aim of the current study was to analyze the correlation between subjective (self-reported questionnaires) and objective (speech perception and localization) hearing test results in adult cochlear implant (CI) users. Secondary, the correlation between subjective and objective hearing tests was compared between bilateral and unilateral CI patients.
Data for this study were prospectively collected as part of a multicentre randomized controlled trial. Thirty-eight postlingually deafened adult patients were randomly allocated to receive either unilateral (n = 19) or bilateral (n = 19) cochlear implantation. We used data gathered after one year of follow-up. We studied the correlation between objectively measured speech perception and localization skills on the one hand and related domains of the Speech, Spatial and Qualities of Hearing Scale (SSQ) and Nijmegen Cochlear Implant Questionnaire (NCIQ) on the other hand. We also compared these correlations between unilateral and bilateral CI users.
We found significant weak to moderate negative correlations between the subjective test results (speech domain of the SSQ and the advanced speech perception domain of the NCIQ) and the related objective speech perception in noise test results (r = −0.33 to −0.48). A significant moderate correlation was found between the subjective test results (spatial domain of the SSQ) and the related objective localization test results (r = 0.59). The correlations in the group of bilateral CI patients (r = −0.28 to −0.54) did not differ significantly from the correlations in the group of unilateral CI patients (r = 0.15 to −0.40).
Current objective tests do not fully reflect subjective everyday listening situations. This study elucidates the importance and necessity of questionnaires in the evaluation of cochlear implantation. Therefore, it is advised to evaluate both objective and subjective tests in CI patients on a regular basis.
This trial was registered on March 11, 2009 in the Dutch Trial Register. Trial registration number: NTR1722.
Cochlear implantation is a successful treatment for severe to profound sensorineural hearing loss. Although unilateral cochlear implantation still is the standard treatment in most countries, an increasing amount of patients worldwide is being implanted bilaterally in order to improve (spatial) hearing skills and speech understanding in noise [1, 2].
The eligibility criteria for cochlear implantation are constantly changing and the quality and possibilities of cochlear implants (CIs) are growing . In this world of new developments, assessing hearing performance after cochlear implantation is vital. There are various methods to do this. In many CI centres, evaluations encompass objective hearing tests only. Clinically applied speech perception and localization tests are robust and reliable, but time-consuming and it is questionable if these test conditions fully represent everyday listening situations. Subjective tests (self-reported questionnaires) are easy to administer and a large set of data can be gathered in a short period of time. Also, in today’s healthcare, a patients’ subjective experiences gain importance [4, 5]. For example, when the cost-effectiveness of a treatment is analyzed, health related quality of life questionnaires are often used to measure the effectiveness [6, 7]. However, questions can be misinterpreted and missing values easily occur when patients do not fill out (parts of) the questionnaires.
Literature has shown that there are often discrepancies between subjective and objective hearing test results [8,9,10,11,12,13]. Previous studies were mainly about the correlation between subjective and objective speech perception tests. The amount of literature on correlations between subjective and objective localization tests is limited .
There is an ongoing global discussion on whether or not bilateral cochlear implantation should be standard care for bilateral deafness [1, 2]. The current literature on correlations between subjective and objective tests however, only includes unilateral and bimodal CI users. Correlations between tests might be different for unilateral and bilateral CI users, due to differences in test sensitivity or differences in indicating their own performance. Therefore, the latter is worth investigating.
The current study is a subanalysis of a previous published study on the comparison of bilateral and unilateral cochlear implantation in adult patients with bilateral postlingual deafness . One year after implantation, bilaterally implanted patients performed significantly better on part of the subjective (Speech, Spatial and Qualities of Hearing Scale (SSQ) and the visual analogue scale (VAS) on hearing) and objective (speech perception in noise when noise came from different directions and localization of sounds) tests .
The first objective of the current study was to investigate the correlations between subjective and objective speech perception and localization tests in adult CI patients. Secondary, the correlations between subjective and objective speech perception and localization tests were compared between bilateral and unilateral CI patients.
Study design and participants
The current study will present the results of a secondary analysis of data collected as part of a multicentre randomized controlled trial on the benefits of simultaneous bilateral cochlear implantation compared to unilateral cochlear implantation in adults with severe to profound bilateral postlingual sensorineural hearing loss . Between December 2009 and September 2012, 38 adult patients were included in this study. After giving informed consent, patients were randomly allocated to receive cochlear implants bilaterally or unilaterally. All patients were implanted with Advanced Bionics HiRes90K (Advanced Bionics, Sylmar, California) CIs and used Harmony processors.
In this paper, we will present the correlation between subjective and objective hearing tests measured one year after implantation. Detailed descriptions of the study methods and the main study results have been reported previously [14, 15].
Subjective hearing outcomes
Subjective benefits in everyday listening situations were assessed with the following questionnaires:
Speech, Spatial and Qualities of Hearing Scale (SSQ). This questionnaire consists of three domains of questions. Participants were asked to rate their hearing capabilities on a 0–100 scale (0 = not capable at all, 100 = perfectly capable). The SSQ1 comprises questions on speech understanding in silence, in background noise, in resonating environments and on the telephone. The SSQ2 comprises questions on spatial hearing; identifying directions of sounds and distance approximation, and the SSQ3 encompasses questions on the quality of hearing . The final subdomain score is computed by the mean of all items on that subdomain, resulting in a range of scores from 0 to 100. A higher score reflects a greater ability .
Nijmegen Cochlear Implant Questionnaire (NCIQ). This questionnaire contains six subdomains of hearing that are rated categorically (1–5 (never-always) and “not applicable”). The subdomains are 1. Basic sound perception, 2. Advanced sound perception (in difficult daily listening situations or background noise), 3. Speech production, 4. Self-esteem, 5. Activity limitations, 6. Social interaction . The answer categories must first be transformed (1 = 0, 2 = 25, 3 = 50, 4 = 75 and 5=100). Afterwards, the final subdomain score is computed by adding together all the item scores and dividing by the number of completed items, resulting in a range of scores from 0 to 100. A higher score reflects a greater ability .
Objective hearing outcomes
Speech perception in noise and sound localization tests were conducted with the Dutch version of the AB-York crescent of sound. The test battery included the Utrecht Sentence Test with Adaptive Randomized Roving levels (U-STARR), the speech-intelligibility test with spatially separated sources (SISSS), and a sound localization test .
With the U-STARR, sentences were presented in noise, both coming from straight ahead. The sentences were presented at 65, 70 or 75 dB SPL (randomly selected), in noise with an adaptive level. The outcome was the signal-to-noise ratio (SNR) average of the last sixteen sentences, which is the speech reception threshold in noise (SRTn) .
For the SISSS, the same procedure was used as for the U-STARR. The only difference was that the sentences were presented from 60° to the left (−60° azimuth) or to the right (+60° azimuth) of the subject and the noise was presented from 60° at the opposite side .
A SRTn of 30 dB was considered relative silence and therefore, 30 dB was used as cutoff value on the U-STARR and SISSS.
For the sound localization test, a phrase ‘Hello what’s this?’ was randomly presented from loudspeakers at 0°, ±15°, ±30° and ±60° angles, about 30 times per condition. Again, the phrase was randomly presented at 60, 65, or 70 dB SPL. The result of this test was the percentage of correct responses . In the current article, the average of all three conditions was used as the localization score.
In the unilateral group, patients were encouraged to use a contralateral hearing aid (HA). The scores on the objective tests in their daily hearing situation (only CI or CI + HA) were used for the analyses. When sounds come from different directions, patients usually have a “best performing situation” and a “worst performing situation”. A patient’s “best performing situation” occurs when sound is presented to the best hearing ear and noise to the worst hearing ear. In the unilateral group, the best hearing ear is the implanted ear. In the bilateral group, patients usually also have one ear with which they hear (slightly) better than with the other. We defined the “best performing situation” and “worst performing situation” for each patient .
None of the subjective and objective test results were normally distributed. Therefore, medians, interquartile ranges (IQR) and non-parametric tests were used.
In order to get insight in the relation between the subjective and objective tests, scatter plots of individual patient scores were created with the subjective test score on the x-axis and the related objective test score on the y-axis.
We used Spearman correlation tests to quantify the relationship between subjective and objective test results. We studied the relation between the U-STARR and SISSS scores (objective) and the first domain of the SSQ (SSQ1) and the advanced sound perception domain of the NCIQ (subjective). These tests all represent advanced sound perception skills. The second domain of the SSQ (SSQ2) contains questions on sound localization, thus, we studied the relation between the SSQ2 and the objective sound localization test.
The correlations between subjective and objective tests were analyzed for the whole study group (n = 38), and for the bilateral and unilateral CI patients separately. We used the Fisher’s z transformation to analyze if there was a statistical significant difference between the correlations in the bilateral and unilateral CI group.
A correlation of <0.19 is considered very weak, 0.20–0.39 weak, 0.40–0.59 moderate, 0.60–0.79 strong, >0.80 very strong (for positive as well as negative values) . For the speech in noise tests (U-STARR and SISSS), a low result indicates good performance, while for the localization tests and subjective tests, a high score indicates good performance. For this reason, when speech in noise results are compared with subjective outcomes, correlations are often negative. All data were analyzed using SPSS 22.0. The critical significance levels of the p-values were adjusted for multiple comparisons using the Benjamini-Hochberg false discovery rate method .
Details of the study population are presented in Table 1. Fifteen patients in the bilateral CI group used HAs before implantation, compared to 19 patients in the unilateral group (p: 0.04) . All other baseline characteristics did not differ significantly. One year after cochlear implantation, 14 out of 19 patients in the unilateral group still used a contralateral HA.
Correlation between subjective and objective speech perception tests
Figure 1 presents scatter plots of the individual patient scores on the subjective (SSQ1 and the advanced speech perception domain of the NCIQ) and objective speech perception tests (U-STARR and SISSS). The correlations between all these subjective and objective speech perception tests were weak to moderate, but significant (Table 2). The weakest correlation was found for the ‘SSQ1’ and ‘SISSS worst performing situation’ (r = −0.33, p = 0.046) and the strongest correlation for the ‘NCIQ advanced speech perception’ and ‘SISSS best performing situation’ (r = −0.48, p = 0.002). The ‘NCIQ advanced speech perception domain’ correlated better with the different objective speech perception tests (r between −0.39 and −0.48 corresponding moderate correlations) than the SSQ1 (r between −0.33 and −0.39, corresponding with weak correlations).
Correlation between subjective and objective localization tests
Figure 2 presents a scatter plot for the individual patient scores on the subjective (SSQ2) and objective localization test. A significant moderate correlation was found between the SSQ2 and localization test (r = 0.59, p = 0.0001) (lower part of Table 2).
When we corrected for multiple testing using the Benjamini-Hochberg false discovery rate method, all p-values of the correlation coefficients were lower than the for multiple testing corrected significance level, resulting in all significant correlations (Table 2).
Comparison of correlations between bilateral and unilateral CI patients
As presented in Table 3, the correlations between all subjective and objective hearing tests ranged between −0.28 and −0.55 (weak to moderate) in the bilateral CI group, compared to a range of −0.15 to −0.43 (very weak to moderate) in the unilateral CI group. The correlation coefficients in the bilateral group did not differ significantly from the correlation coefficients in the unilateral group, after correction for multiple testing using the Benjamini-Hochberg false discovery rate method (Table 3).
In this study, we found significant correlations between subjective and objective hearing test results in adult CI users. The strongest correlation was found between the spatial domain of the SSQ and the objective localization test (r = 0.59, a moderate correlation). The other correlations, between subjective and objective speech perception in noise test results, were weak to moderate. There could be several reasons for the lack of strong correlations between subjective and objective results. Perhaps the questionnaires and objective tests do not represent the same hearing skills. Another reason could be that the patients’ views of their own hearing skills did not match their actual hearing capabilities. Therefore, it seems important to evaluate both subjectively and objectively measured hearing skills after cochlear implantation.
When we compared the outcomes of the unilateral and bilateral CI group, all correlations in the bilateral CI group were stronger than in the unilateral group, although none of the correlations differed statistically significant from each other. We cannot rule out that the latter is the result of the small sample size: 19 patients in each group.
Comparison with the literature
A recently published meta-analysis reviewed the correlation between different types of (subjective) hearing-specific and CI-specific questionnaires and (objective) speech perception scores in CI patients . Thirteen studies were included. These studies showed low correlations between hearing-specific and CI-specific questionnaires on the one hand and objective speech perception scores on the other hand . The pooled correlation between CI-specific questionnaire scores (for example NCIQ) and speech perception in noise was weak (r = 0.26, p:0.0064). Other studies, not included in the meta-analysis, also found predominantly weak to moderate correlations between subjective and objective speech perception tests [9,10,11,12,13]. In a study of Hirschfelder et al. subjective and objective hearing tests were compared in 56 unilateral CI users . They found significant weak to moderate (r = 0.28–0.56) correlations between the NCIQ total score, the NCIQ advanced sound perception, the NCIQ speech production domains and both objective speech perception tests (Freiburger monosyllable test in quiet and Hochmair, Schulz, Mozer (HSM) sentence test in noise). Damen et al. studied 69 postlingually deafened adult patients (59 unilaterally implanted and 10 non-implanted) and found significant correlations between the NCIQ total score and two Dutch standardized speech perception tests in quiet (the Antwerp-Nijmegen syllable (r = 0.48) and the NVA phoneme test (r = 0.32)) . In a study of Brendel et al. the Everyday Listening Questionnaire (ELQ) 2 was significantly correlated to objective speech perception tests (Monosyllables, HSM in quiet and HSM in noise), but the strength of the correlations was not mentioned . To date, only one study included objective spatial hearing tests . Heo et al. reviewed the correlation between all domains of the SSQ and objective speech perception and localization tests in 14 unilateral CI recipients with a contralateral HA . The spatial domain of the SSQ was significantly correlated with the environmental sound localization (r = 0.57) and perception (r = 0.55) scores. The quality domain was significantly correlated with all perception scores (r = 0.54–0.66) . To our knowledge, there is no previous literature on the differences in correlations between bilateral and unilateral CI patients.
A drawback of some of the previous studies is the lack of clear hypotheses. That has resulted in the presentation of multiple random correlations between objective test scores and questionnaire scores without clear clinical relevance. Also, the authors did not correct for multiple testing. Nevertheless, our findings are in agreement with the previous literature, and our study methodologically fills the gaps of previously mentioned studies. We chose to study only clinically relevant relations by combining (parts of the) subjective tests with corresponding objective tests. To minimise the chance of finding incidental results we corrected for multiple testing. Another strength of our study is the use of prospectively collected data. All participants had completed the questionnaires one year after implantation and had performed the objective tests within the same week. None of the participants were lost to follow-up and we did not have any missing data. Also, to our knowledge our study is the first to investigate correlations between subjective and objective test results in bilateral CI patients. A weakness of the study is the small sample size. This might be the reason why we found some insignificant results after correcting for multiple testing.
In this study, correlations between subjective and objective speech perception and spatial hearing tests were weak to moderate, but significant, in adult CI patients. The correlation between subjective and objective hearing tests seemed not different for bilateral compared to unilateral CI patients. This study elucidates the importance and necessity of questionnaires in the evaluation of cochlear implantation. Also it shows that patients may experience their own hearing performance differently than objective tests would suggest. Therefore, it is advised to use both objective and subjective tests in cochlear implant patients on a regular basis.
- dB SPL:
Decibel, sound pressure level
Everyday listening questionnaire
Hochmair, Schulz, Mozer
Nijmegen cochlear implant questionnaire
Nederlandse Vereniging voor Audiologie (Dutch association for Audiology)
The speech-intelligibility test with spatially separated sources
Speech reception threshold in noise
Speech, spatial and qualities of hearing scale
Utrecht Sentence Test with Adaptive Randomized Roving levels
Visual analogue scale
van Schoonhoven J, Sparreboom M, van Zanten BG, et al. the effectiveness of bilateral Cochlear implants for severe-to-profound deafness in Adults: a systematic review. Otol Neurotol. 2013;34(2):190–8. doi:10.1097/MAO.0b013e3181e3d62c.
Basura GJ, Eapen R, C a B. Bilateral cochlear implantation: current concepts, indications, and results. Laryngoscope. 2009;119(12):2395–401. doi:10.1002/lary.20751.
Hwang CF, Chen Y, Lin HC, Narayanan P, SH O, Truy E. Cochlear implant and its related science. Biomed Res Int. 2015;2015:8–9. doi:10.1155/2015/683967.
Deshpande PR, Rajan S, Lakshmi Sudeepthi B. Patient-reported outcomes : A new era in clinical research. 2011;2(4). doi:10.4103/2229-3485.86879.
Capretta NR, Moberly AC. Does quality of life depend on speech recognition performance for adult Cochlear implant Users ? March. 2016:699–706. doi:10.1002/lary.25525.
Ramakers GGJ, Smulders YE. Van Zon A, et al. Agreement between health utility instruments in cochlear implantation. Clin Otolaryngol. 2016;41(6):737–43. doi:10.1111/coa.12626.
Torrance GW. Utility approach to measuring health-related quality of. life. 1987;40(6)
Mcrackan TR, Bauschard M, Hatch JL, et al. Meta-analysis of Quality-of-Life Improvement After Cochlear Implantation and Associations With Speech Recognition Abilities. 2017:1-9. doi:10.1002/lary.26738.
Damen GWJA, Beynon AJ, Krabbe PFM, Mulder JJS, Mylanus EAM. Cochlear implantation and quality of life in postlingually deaf adults: long-term follow-up. Otolaryngol - Head Neck Surg. 2007;136(4):597–604. doi:10.1016/j.otohns.2006.11.044.
Heo J-H, Lee J-H, Lee W-S. Bimodal benefits on objective and subjective outcomes for adult cochlear implant users. Korean J Audiol. 2013;17(2):65–73. doi:10.7874/kja.2013.17.2.65.
Hirschfelder A, Gräbel S, Olze H. The impact of cochlear implantation on quality of life: the role of audiologic performance and variables. Otolaryngol - Head Neck Surg. 2008;138(3):357–62. doi:10.1016/j.otohns.2007.10.019.
Brendel M, Frohne-Buechner C, Lesinski-Schiedat A, Lenarz T, Buechner A. Everyday listening questionnaire: correlation between subjective hearing and objective performance. Cochlear Implants Int. 2014;15(1):13–9. doi:10.1179/1754762813Y.0000000030.
Moberly AC, Harris MS, Boyce L, et al. Relating Quality of Life to Outcomes and Predictors in Adult Cochlear Implant Users : Are We Measuring the Right Things ? 2017:1-8. doi:10.1002/lary.26791.
Smulders YE, van Zon A, Stegeman I, et al. Comparison of bilateral and unilateral Cochlear implantation in adults: a randomized clinical trial. JAMA Otolaryngol Head Neck Surg. 2016:1–8. doi:10.1001/jamaoto.2015.3305.
Smulders YE, Rinia AB, Pourier VEC, et al. Validation of the U-STARR with the AB-York crescent of sound, a new instrument to evaluate speech intelligibility in noise and spatial hearing skills. Audiol Neurotol Extra. 2015;5(1):1–10. doi:10.1159/000370300.
Gatehouse S, Noble W. The speech, spatial and qualities of hearing scale (SSQ). Int J Audiol. 2004;43(2):85–99. doi:10.1080/14992020400050014.
Hinderink JB, Krabbe PF, Van Den Broek P. Development and application of a health-related quality-of-life instrument for adults with cochlear implants: the Nijmegen cochlear implant questionnaire. Otolaryngol Head Neck Surg. 2000;123(6):756–65. doi:10.1067/mhn.2000.108203.
Website BMJ. http://www.bmj.com/about-bmj/resources-readers/publications/statistics-square-one/11-correlation-and-regression. Accessed 25 Sept 2017.
Benajmini Y, Hochberg Y. Controlling the false discovery Rate : a practical and powerful approach to multiple testing author ( s ): Yoav Benjamini and Yosef Hochberg Source: Journal of the Royal Statistical Society. Series B (methodological), Vol. 57, no. 1 published by. J R Stat Soc B. 1995;57(1):289–300.
We thank all patients included in this trial. Furthermore, we thank Robert J. Stokroos, Rolien H. Free, Johan H.M. Frijns, Wendy J. Huinck, Emmanuel A.M. Mylanus, Nadia Hendrice, Bert Maat, and Jeroen J. Briaire for their efforts in the early stages of this trial.
This study is sponsored by Advanced Bionics ®. The sponsor collaborated with us on the study design. They did not have any influence on the data collection, data analysis or data interpretation.
Availability of data and materials
The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This study was approved by the Human Ethics Committees of all participating centers (NL2466001808): the Medical Ethics Committee of the Academic Medical Centers of Amsterdam, Utrecht, Maastricht, Nijmegen, Leiden, and Groningen. Written informed consent was obtained from all individual participants included in the study. Trial registration: NTR1722, Dutch Trial register, registered March 11, 2009.
Consent for publication
Wilko Grolman receives non-restrictive grants from Advanced Bionics, MedEl, Oticon and Cochlear. All other authors report no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Ramakers, G.G.J., Smulders, Y.E., van Zon, A. et al. Correlation between subjective and objective hearing tests after unilateral and bilateral cochlear implantation. BMC Ear Nose Throat Disord 17, 10 (2017). https://doi.org/10.1186/s12901-017-0043-y
- Cochlear implantation
- Hearing tests