This page is for health professionals only.

NO
I AM NOT
A HEALTHCARE PROFESSIONAL.
Validity and Reliability of the Glaucoma Knowledge Level Questionnaire
PDF
Cite
Share
Request
Original Article
VOLUME: 48 ISSUE: 3
P: 115 - 121
June 2018

Validity and Reliability of the Glaucoma Knowledge Level Questionnaire

Turk J Ophthalmol 2018;48(3):115-121
1. Eskişehir Osmangazi University Faculty of Medicine, Department of Public Health, Eskişehir, Turkey
2. Eskişehir Osmangazi University Faculty of Medicine, Department of Ophthalmology, Eskişehir, Turkey
No information available.
No information available
Received Date: 07.09.2017
Accepted Date: 18.12.2017
Publish Date: 28.06.2018
PDF
Cite
Share
Request

ABSTRACT

Objectives:

The present study was conducted to develop an instrument for measuring adults’ glaucoma knowledge levels and to establish the instrument’s validity and reliability.

Materials and Methods:

The study group consisted of 811 persons aged 40-80 years who presented to primary health care institutions and did not have a glaucoma diagnosis. A 27-item questionnaire measuring level of glaucoma knowledge was created by the study team. Following expert consultation, it was structurally evaluated. The difficulty index and discrimination index were calculated for each item. Factor analysis was used to determine construct validity, Cronbach’s alpha internal consistency coefficient and item-total correlations were calculated to determine reliability. Confirmatory factor analysis was used to assess the extent to which the factor structure of the scale fit. We analysed correlation with the National Eye Health Education Program (NEHEP) Eye-Q scale in order to evaluate the validity of the scale.

Results:

The final glaucoma knowledge level questionnaire comprised 10 items in one dimension. The discrimination index and difficulty index ranged between 0.28 to 0.65 and 33 to 61%, respectively. According to factor analysis, the Kaiser-Meyer-Olkin score was 0.760 and Bartlett’s test indicated p<0.001. Confirmatory factor analysis showed acceptable scale fit and fit indices. Validity assessment revealed a positive correlation between the total score of the items of the NEHEP scale and glaucoma knowledge level questionnaire score (r=0.522; p<0.001). Scores were higher in participants who were aged 40-64, living in the city, had education level of high school or above and had previous eye examination or intraocular pressure measurement.

Conclusion:

The glaucoma knowledge level questionnaire has the distinction of being the first valid and reliable scale for assessing level of glaucoma knowledge in Turkey.

Keywords:
Glaucoma, level of knowledge, scale development

Introduction

Glaucoma is an optic neuropathy characterized by loss of retinal ganglion cells, optic nerve atrophy and visual field loss.1 This global public health problem is the most common cause of blindness in the world after cataract.2 It is estimated that glaucoma affects more than 60 million people in the world and that this number will exceed 100 million by the year 2040. Because early glaucoma is usually asymptomatic, many people are unaware of the disease until the onset of vision loss.3,4 Early diagnosis can prevent glaucoma-related blindness and its adverse effects on quality of life.5 It is estimated that about 90% of glaucoma-related blindness can be prevented with early and appropriate treatment.6

Timely eye examinations and appropriate treatment are critical to reduce visual impairment and blindness caused by glaucoma. However, many people in developing countries do not have regular and timely eye examinations due to a lack of knowledge and awareness about glaucoma-related blindness.6 As glaucoma does not cause obvious symptoms such as pain, many people do not undergo screening for early diagnosis.2 Glaucoma awareness is especially low in rural areas and poor communities.6 Some authors have reported that awareness of glaucoma is insufficient even in Western societies.7,8 In addition to the early recognition of asymptomatic patients, the treatment of diagnosed patients is also an important link in controlling glaucoma. Therefore, knowledge and awareness about glaucoma must be increased among both the general population and glaucoma patients. Patient education has also been shown to improve treatment adherence.1

Although tools have been used in studies conducted on various populations to determine the level of knowledge regarding glaucoma and related risk factors, there are no valid and reliable tools for the Turkish population.

This study was conducted to develop a scale that assesses the knowledge level of Turkish adults about glaucoma and to ensure the validity and reliability of this scale.

Materials and Methods

Results

Discussion

The aim of this study was to develop a scale to measure the level of glaucoma knowledge in a community-based sample and to test the validity and reliability of the scale. In order to determine how effectively scale items assess knowledge, they must be evaluated based on item discrimination and difficulty indices. For this scale, item discrimination index values ranged from 0.28 to 0.65 and difficulty index values ranged from 33% to 61%. An item discrimination index of 0.2 or higher is considered acceptable and indicative that the item can distinguish between the unknowledgeable and the knowledgeable.14 None of the previously developed glaucoma scales were tested for item discrimination and difficulty indices.

For a reliable scale, the Cronbach’s alpha value should be at least 0.70.15 The Cronbach’s alpha value of our scale was 0.69, which was considered adequate. Previously developed glaucoma knowledge scales had lower Cronbach’s alpha values. In fact, although the NEHEP scale is the most widely accepted scale for measuring level of glaucoma knowledge, its Cronbach’s alpha value is 0.59.16 Therefore, we believe our scale is reliable. Removal of single items from the scale did not result in a significant increase in the Cronbach’s alpha value, indicating good consistency between the scale items.

CFA was done to ascertain whether the model of the 10-item, one-dimensional GKLQ developed with an EFA was confirmed. The first value to be examined in CFA is the p value. This value indicates the significance of the difference between the expected covariance matrix and the observed covariance matrices (c2). Naturally, a nonsignificant p value is desired. However, it is also normal for the p value to be significant due to a large sample size. In this study, a significant p value was tolerated and alternative fit indices were evaluated.17 It is reported that the RMSEA value must be below 0.08 and the GFI and AGFI values must be higher than 0.90 in order for the model fit to be regarded as acceptable.13 For this scale, CFA yielded values of 0.082 for RMSEA, 0.95 for GFI and 0.92 for AGFI. These values were evaluated according to fit indices and it was determined that all were at an acceptable level for model fit. Consequently, we consider this evidence that the factor construct resulting from the EFA is strongly confirmed.

We consider the one-dimensional nature of the scale and the small number of items as appropriate for the purpose of the study. There is still no ideal scale for measuring levels of glaucoma knowledge. The NEHEP scale has gained more acceptance compared to other scales. Based on item analyses, three of the items in the NEHEP scale (“Glaucoma is more common among people with glaucoma in their family.”, “The risk of having glaucoma is higher among people over 60 years of age.”, “Glaucoma can be controlled.”) remained in the scale. We believe that the inclusion of items pertaining to the risk factors and treatability of glaucoma in our scale will result in wider acceptance.

Evaluation of GKLQ scores according to sociodemographic characteristics showed that scores were higher among people less than 65 years of age, those living in urban areas, those with education level of high school or higher and those with good income level. These findings are consistent with studies reporting that young age and good socioeconomic and education level are factors that increase knowledge and awareness of glaucoma.18,19,20 In addition, the participants in our study group who had previously undergone eye examinations and ocular pressure measurement scored higher on the scale. This supports the reliability of the scale.

Conclusion

The scale created in this study is not designed to investigate all aspects of glaucoma knowledge. However, the GKLQ is the first scale for determining glaucoma knowledge in Turkey that has been tested for validity and reliability. While previously published tools assessing glaucoma knowledge generally targeted glaucoma patients, the GKLQ is designed as a simple and quick measurement tool that can also be applied to the general population. The reliability of the scale in specific groups needs to be tested and the scale requires further research and development.

References

1
  1. Gray TA, Orton LC, Henson D, Harper R, Waterman H. Interventions for improving adherence to ocular hypotensive therapy. Cochrane Database Syst Rev. 2009;CD:006132 [PubMed] [Google Scholar]
  2. De-Gaulle VF, Dako-Gyeke P. Glaucoma awareness, knowledge, perception of risk and eye screening behaviour among residents of Abokobi, Ghana. BMC Ophthalmol. 2016;16:204. [PMC free article] [PubMed] [Google Scholar]
  3. Pan CW, Zhao CH, Yu MB, Cun Q, Chen Q, Shen W, Li J, Xu JG, Yuan Y, Zhong H. Prevalence, types and awareness of glaucoma in a multi‐ethnic population in rural China: the Yunnan Minority Eye Study. Ophthalmic and Physiological Optics. 2016;36:664–670. [PubMed] [Google Scholar]
  4. Chua J, Baskaran M, Ong PG, Zheng Y, Wong TY, Aung T, Cheng CY. Prevalence, risk factors and visual features of undiagnosed glaucoma: the Singapore Epidemiology of Eye Diseases Study. JAMA Ophthalmol. 2015;133:938–946. [PubMed] [Google Scholar]
  5. Kyari F, Chandler CI, Martin M, Gilbert CE. So let me find my way, whatever it will cost me, rather than leaving myself in darkness: experiences of glaucoma in Nigeria. Glob Health Action. 2016;9:31886. [PMC free article] [PubMed] [Google Scholar]
  6. Adegbehingbe BO, Bisiriyu LA. Knowledge, attitudes and self care practices associated with glaucoma among hispital workers in Ile-Ife, Osun State, Nigeria. Tanzan J Health Res. 2008;10:240–245. [PubMed] [Google Scholar]
  7. Costa VP, Spaeth GL, Smith M, Uddoh C, Vasconcellos JP, Kara-Jose N. Patient education in glaucoma: what do patients know about glaucoma? Arq Bras Oftalmol. 2006;69:923–927. [PubMed] [Google Scholar]
  8. Yen MT, Wu CY, Higginbotham EJ. Importance of increasing public awareness regarding glaucoma. Arch Ophthalmol. 1996;114:635. [PubMed] [Google Scholar]
  9. National Eye Health Education Program (NEHEP) Program. Eye-Q Test. available date:14.03.2017.. [Internet] https://nei.nih.gov/sites/default/files/nehep-pdfs/EyeQTest_for_Toolkit.pdf .
  10. Doi Y, Minowa M. Factor structure of the 12-item General Health Questionnaire in the Japanese general adult population. Psychiatry Clin Neurosci. 2003;57:379–383. [PubMed] [Google Scholar]
  11. Arıkan İ, Metintaş S, Kalyoncu C, Yıldız Z. Kardiyovasküler Hastalıklar Risk Faktörleri Bilgi Düzeyi (KARRİF-BD) Ölçeği’nin geçerlik ve güvenirliği. Türk Kardiyol Dern Araş. 2009;37:35–40. [PubMed] [Google Scholar]
  12. Kline P. A General Description Of Factor Analysis. An Easy Guide to Factor Analysis. New York: Routledge; 1994. pp. 10–11. [Google Scholar]
  13. Erkorkmaz Ü, Etikan İ, Demir O, Özdamar K, Sanisoğlu SY. Doğrulayıcı faktör analizi ve uyum indeksleri. Turkiye Klinikleri J Med Sci. 2013;33:210–223. [Google Scholar]
  14. McCowan RJ, McCowan SC. Item Discrimination. Item Analysis for Criterion-Referenced Tests. New York: Center for Development of Human Services; 1999. pp. 20–21. [Google Scholar]
  15. Skoskiewicz-Malinowska K, Kaczmarek U, Zietek M, Malicka B. Validation of the Polish version of the oral health impact profile-14. Adv Clin Exp Med. 2015;24:129–137. [PubMed] [Google Scholar]
  16. Rao VS, Peralta EA, Rosdahl JA. Validation of a glaucoma knowledge assessment in glaucoma patients. Clin Ophthalmol. 2016;10:1913–1918. [PMC free article] [PubMed] [Google Scholar]
  17. Gökler ME, Öz F, Metintaş S. Reliability and validity of Medical Profession Value Perception Scale and results in medical students. Turkish Journal of Public Health. 2017;15:26–36. [Google Scholar]
  18. Hoevenaars JG, Schouten JS, van den Borne B, Beckers HJ, Webers CA. Socioeconomic differences in glaucoma patients’ knowledge, need for information and expectations of treatments. Acta Ophthalmol Scand. 2005;84:84–91. [PubMed] [Google Scholar]
  19. Saw S, Gazzard G, Friedman D, Foster PJ, Devereux JG, Wong ML, Seah S. Awareness of glaucoma and health beliefs of patients suffering primary acute angle closure. Br J Ophthalmol. 2003;87:446–449. [PMC free article] [PubMed] [Google Scholar]
  20. Labiris G, Katsanos A, Fanariotis M, et al. A proposed methodology for the assessment of glaucoma awareness in Greece: introduction of the EIT-8G scale. Eur J Ophthalmol. 2012;22:95–103. [PubMed] [Google Scholar]
2
Gray TA, Orton LC, Henson D, Harper R, Waterman H. Interventions for improving adherence to ocular hypotensive therapy. Cochrane Database Syst Rev. 2009;CD:006132 [PubMed] [Google Scholar]
3
De-Gaulle VF, Dako-Gyeke P. Glaucoma awareness, knowledge, perception of risk and eye screening behaviour among residents of Abokobi, Ghana. BMC Ophthalmol. 2016;16:204. [PMC free article] [PubMed] [Google Scholar]
4
Pan CW, Zhao CH, Yu MB, Cun Q, Chen Q, Shen W, Li J, Xu JG, Yuan Y, Zhong H. Prevalence, types and awareness of glaucoma in a multi‐ethnic population in rural China: the Yunnan Minority Eye Study. Ophthalmic and Physiological Optics. 2016;36:664–670. [PubMed] [Google Scholar]
5
Chua J, Baskaran M, Ong PG, Zheng Y, Wong TY, Aung T, Cheng CY. Prevalence, risk factors and visual features of undiagnosed glaucoma: the Singapore Epidemiology of Eye Diseases Study. JAMA Ophthalmol. 2015;133:938–946. [PubMed] [Google Scholar]
6
Kyari F, Chandler CI, Martin M, Gilbert CE. So let me find my way, whatever it will cost me, rather than leaving myself in darkness: experiences of glaucoma in Nigeria. Glob Health Action. 2016;9:31886. [PMC free article] [PubMed] [Google Scholar]
7
Adegbehingbe BO, Bisiriyu LA. Knowledge, attitudes and self care practices associated with glaucoma among hispital workers in Ile-Ife, Osun State, Nigeria. Tanzan J Health Res. 2008;10:240–245. [PubMed] [Google Scholar]
8
Costa VP, Spaeth GL, Smith M, Uddoh C, Vasconcellos JP, Kara-Jose N. Patient education in glaucoma: what do patients know about glaucoma? Arq Bras Oftalmol. 2006;69:923–927. [PubMed] [Google Scholar]
9
Yen MT, Wu CY, Higginbotham EJ. Importance of increasing public awareness regarding glaucoma. Arch Ophthalmol. 1996;114:635. [PubMed] [Google Scholar]
10
National Eye Health Education Program (NEHEP) Program. Eye-Q Test. available date:14.03.2017.. [Internet] https://nei.nih.gov/sites/default/files/nehep-pdfs/EyeQTest_for_Toolkit.pdf .
11
Doi Y, Minowa M. Factor structure of the 12-item General Health Questionnaire in the Japanese general adult population. Psychiatry Clin Neurosci. 2003;57:379–383. [PubMed] [Google Scholar]
12
Arıkan İ, Metintaş S, Kalyoncu C, Yıldız Z. Kardiyovasküler Hastalıklar Risk Faktörleri Bilgi Düzeyi (KARRİF-BD) Ölçeği’nin geçerlik ve güvenirliği. Türk Kardiyol Dern Araş. 2009;37:35–40. [PubMed] [Google Scholar]
13
Kline P. A General Description Of Factor Analysis. An Easy Guide to Factor Analysis. New York: Routledge; 1994. pp. 10–11. [Google Scholar]
14
Erkorkmaz Ü, Etikan İ, Demir O, Özdamar K, Sanisoğlu SY. Doğrulayıcı faktör analizi ve uyum indeksleri. Turkiye Klinikleri J Med Sci. 2013;33:210–223. [Google Scholar]
15
McCowan RJ, McCowan SC. Item Discrimination. Item Analysis for Criterion-Referenced Tests. New York: Center for Development of Human Services; 1999. pp. 20–21. [Google Scholar]
16
Skoskiewicz-Malinowska K, Kaczmarek U, Zietek M, Malicka B. Validation of the Polish version of the oral health impact profile-14. Adv Clin Exp Med. 2015;24:129–137. [PubMed] [Google Scholar]
17
Rao VS, Peralta EA, Rosdahl JA. Validation of a glaucoma knowledge assessment in glaucoma patients. Clin Ophthalmol. 2016;10:1913–1918. [PMC free article] [PubMed] [Google Scholar]
18
Gökler ME, Öz F, Metintaş S. Reliability and validity of Medical Profession Value Perception Scale and results in medical students. Turkish Journal of Public Health. 2017;15:26–36. [Google Scholar]
19
Hoevenaars JG, Schouten JS, van den Borne B, Beckers HJ, Webers CA. Socioeconomic differences in glaucoma patients’ knowledge, need for information and expectations of treatments. Acta Ophthalmol Scand. 2005;84:84–91. [PubMed] [Google Scholar]
20
Saw S, Gazzard G, Friedman D, Foster PJ, Devereux JG, Wong ML, Seah S. Awareness of glaucoma and health beliefs of patients suffering primary acute angle closure. Br J Ophthalmol. 2003;87:446–449. [PMC free article] [PubMed] [Google Scholar]
21
Labiris G, Katsanos A, Fanariotis M, et al. A proposed methodology for the assessment of glaucoma awareness in Greece: introduction of the EIT-8G scale. Eur J Ophthalmol. 2012;22:95–103. [PubMed] [Google Scholar]