- Research article
- Open Access
Systematic review of the appropriateness of eye care delivery in eye care practice
BMC Health Services Research volume 19, Article number: 646 (2019)
Health care systems are continually being reformed, however care improvement and intervention effectiveness are often assumed, not measured. This paper aimed to review findings from published studies about the appropriateness of eye care delivery, using existing published evidence and/or experts’ practice and to describe the methods used to measure appropriateness of eye care.
A systematic search was conducted using Medline, Embase and CINAHL (2006 to September 2016). Studies reporting the processes of eye care delivery against existing published evidence and/or experts’ practice were selected. Data was extracted from published reports and the methodological quality using a modified critical appraisal tool. The primary outcomes were percentage of appropriateness of eye care delivery. This study was registered with PROSPERO, reference CRD42016049974.
Fifty-seven studies were included. Most studies assessed glaucoma and diabetic retinopathy and the overall methodological quality for most studies was moderate. The ranges of appropriateness of care delivery were 2–100% for glaucoma, 0–100% for diabetic retinopathy and 0–100% for other miscellaneous conditions. Published studies assessed a single ocular condition, a sample from a single centre or a single domain of care, but no study has attempted to measure the overall appropriateness of eye care delivery.
These findings indicated a wide range of appropriateness of eye care delivery, for glaucoma and diabetic eye care. Future research would benefit from a comprehensive approach where appropriateness of eye care is measured across multiple conditions with a single methodology, to guide priorities within eye care delivery and monitor quality improvement initiatives.
Globally, 285 million people of all ages suffer from visual impairment . Long-term ocular conditions, including both ocular diseases (e.g. glaucoma, diabetic retinopathy, age-related macular degeneration and cataract) and uncorrected refractive errors are the major causes of visual impairment worldwide . The prevalence of vision problems is strongly associated with ageing and this compromised visual function affects individuals’ ability to perform activities of daily living . Common eye diseases can often be detected early and their visual impact minimised or they can be prevented by appropriate eye care services, including routine eye examinations [4,5,6]. Due to the growing demand for eye care in the context of resource scarcity, interest in measuring and improving the appropriateness of eye care delivery is growing [7, 8]. Appropriate care is defined as provision of evidence-based care that is relevant to the patient’s needs and based on established standards .
Translation of best available evidence into clinical practice is important, ensuring that both efficacy and cost-effectiveness of patient management is maintained . Evidence-based guidelines aim to translate well conducted scientific trials into easy to apply recommendations. Such guidelines intend to guide practitioners and help them to improve their professional practice and optimize patient care . Evidence-based guidelines are not always adhered to and/or fully implemented in the clinical setting. Adherence to guidelines can be quantitatively measured using quality indicators of appropriateness of care delivery. Quality Indicators can be defined as “measurable components of a standard or guideline, with explicit criteria for inclusion, exclusion, time frame, setting and compliance action” .
Evidence of suboptimal care being delivered exist, arising from several large studies assessing appropriateness of care across different health conditions. The RAND study conducted in 2000 in the United States evaluated performance on 439 quality indicators of appropriateness of care for 30 acute and chronic conditions as well as preventive care. The RAND study showed that American adults received recommended care only 55% (range 11–79%) of the time . More recently, the CareTrack study in Australia showed similar results with 57% (range 13–90%) of Australian adults receiving appropriate care across 22 conditions . Ocular conditions were not included in the CareTrack study . Defining existing eye care practice patterns and current variation from best practices is an important component of a systemic approach to improving appropriateness of eye care [14, 15].
This paper aimed to review findings from published studies about the appropriateness of eye care delivery, using existing published evidence and/or experts’ practice. A secondary aim was to describe and compare the variety of methods used to measure appropriateness of eye care.
Data sources and searches
A systematic search was conducted using Medline, Embase and the Cumulative Index to Nursing and Allied Health Literature (CINAHL) electronic databases to identify studies related to the appropriateness of eye care. The search strategy was reviewed and tested by an academic librarian and reviewed by content experts (IJ and FS). The literature review process followed the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) procedures  and the review protocol was published on PROSPERO (http://www.crd.york.ac.uk/prospero/, reference CRD42016049974). As eye conditions with higher prevalence and heavier burden on the health system, the emphasis was put on glaucoma, diabetic retinopathy, refractive error, cataract and macular degeneration . The search incorporated the three elements:
Profession-specific terms: “Optometr*”, “Ophthalmolog*”, “General practitioner*”, “Orthopt*”, “Ophthalmic nurse*”, “Ophthalmic practitioner*”.
Subject headings: Exp”Quality of Health Care” in Medline, Exp”Health care quality” in Embase, MH”Health Services Research+” in CINAHL.
Condition-specific terms: Exp Glaucoma, Exp diabetic retinopathy, Exp refractive errors, Exp macular degeneration, Exp cataract.
An example of the full electronic search strategy for Medline database is illustrated in Additional file 1.
Reference lists and citations were used to cross-check the results of our search. The reference details and abstracts of the 5596 articles retrieved from the literature search after duplicates removal were reviewed by one reviewer (KCH). Studies assessing the processes of eye care delivery against existing published evidence and experts’ practice (e.g. consultant ophthalmologists’ practice) were included. Studies assessing outcomes of care delivery such as patient satisfaction or those assessing structural aspects of care delivery such as workforce characteristics, infrastructure, regulations and policies were excluded from analysis in this review. The search was not restricted by type of study design, and no other limitations (e.g. population, intervention, comparison, length of follow-up) were set. The search was limited to English and 10 years to the search date (2006 to 16th September 2016). Studies conducted more than 10 years ago were excluded, on the basis that appropriateness of care was likely to change over time, and that older studies might not reflect recent changes in care delivery standards . The references were narrowed to 65 articles after title and abstract screening following the application of exclusion criteria (Fig. 1). A further six articles were excluded after full text review with three that did not access process of care and three that did not measure against existing published evidence or experts’ practice.
Data extraction and quality assessment
Each paper was reviewed and information was extracted based on the following characteristics:
Condition(s) – the eye condition(s) for which the appropriateness of care was assessed
Professions – the health professions delivering the care of the assessed eye condition
Methods – the method used to assess the appropriateness of eye care delivered
Evidence sources – the reference standard used to assess the appropriateness of eye care delivered
Settings – classification based on whether study was conducted in hospital or independent practice
Number of sites – the number of sites that the study was conducted at
Timing – the timing and visit types assessed in the article (e.g. at diagnosis, follow-up, etc)
Percentage of encounters with appropriate eye care – the number of quality indicators met over the total number of relevant quality indicators
Taking into consideration the diversity of study types (e.g. descriptive, interventional and observational studies, record reviews, and surveys), two reviewers (KCH and SA) independently assessed the quality of each article using a validated critical appraisal tool . The applied tool was modified by adding questions from other validated critical appraisal tools including Critical Appraisal Skills Programme (CASP) diagnostic checklist , National Institutes of Health (NIH) Quality Assessment Tool For Observational Cohort And Cross-Sectional Studies , Joanna Briggs Institute (JBI) Critical Appraisal Checklist For Studies Reporting Prevalence Data , Effective Public Health Practice Project (EPHPP) Quality assessment tool for quantitative studies .
The modified quality assessment tool included 17 individual criterions with questions from validated critical appraisal tools [20,21,22,23] (Additional file 2) and grouped in the seven categories listed below:
Quality of reporting (adequate description of the context , clearly stated aims [19,20,21], eligibility , methods and findings )
Selection bias (representative of the selected individuals [22, 23], response rate at least 50% , and sample size justification )
Study design (presence of randomisation , presence of control group [19, 23])
Blinding (blinding of outcome assessors to the intervention or exposure status of participants [20, 21, 23], blinding of participants to research question , and blinding of decision making between participants and experts )
Data collection tools (reliability of the data collection tool [22, 23] and valid reference used to assess the appropriateness of care )
Limitations (key potential confounders are identified and accounted for [21,22,23])
The number of criteria used varied depending on the study design of the publication being reviewed. An overall rating was allocated for each paper as a percentage based on the number of criteria met over the number of relevant criteria for the corresponding study design. If less than 60% criteria relevant to the study design was met, this item was scored as Weak in the quality assessment tool. It was scored moderate if 60–79% of criteria were met and strong if 80–100% of criteria were met. A third reviewer (IJ) resolved any disagreements and consensus was reached through discussion. All articles were included, and the results of critical appraisal are provided in Additional file 3.
Data synthesis and analysis
Due to the anticipated heterogeneity of included studies, no plans were made to pool the results statistically, therefore a meta-analysis was not undertaken. For each study, the range of percentage of appropriate care (summary data from published reports, but not individual patient-level data) and the number of quality indicators were separated according to the nature of the quality indicators into the following six domains of care: ‘history taking’, ‘physical examination’, ‘management’, ‘recall period’, ‘referral’ and ‘patient education’. On occasion, data provided in the papers had to be reclassified to fit these proposed domains of care. Data were also reanalysed as required so that the results could be presented in terms of appropriateness to prescribed care and not the reverse (i.e. percentage with inappropriate care).
Of 6472 citations, 57 articles met the inclusion (see Fig. 1). The characteristics of these studies are presented in Table 1. The majority of the studies were from the United Kingdom (UK) (n = 25) and the United States of America (USA) (n = 15), with Australia (n = 5), Australia and New Zealand (NZ) (n = 2) and other countries accounting for the remainder. Among the 57 papers, two-thirds examined eye care delivery for glaucoma (n = 28) and diabetic retinopathy (n = 11). The majority of papers assessed the care delivered by optometrists (n = 22) and ophthalmologists (n = 19), with another seven studies including both professions. Half of the studies were rated moderate (60–79% of quality criteria met) for the methodological quality (n = 29), another one-third were rated strong (80–100% of quality criteria met) (n = 19) and the remainder were rated weak (< 60% of quality criteria met) (n = 9). For all conditions but diabetic retinopathy, a similar pattern of distribution of methodological quality (i.e. mostly moderate) was observed. However, for diabetic retinopathy most of the studies (73%) were rated strong in methodological quality.
Record review (26 of 57 studies) and practitioner survey with or without case vignettes (15 of 57 studies) were the most commonly used methods, with one study using a combination of both methods and one study using both methods with claims data and patient survey. When eye care appropriateness was measured using record review, assessments were most frequently conducted at a single site (n = 19) and in these cases, studies were conducted in a hospital setting (Fig. 2). Use of a single site reduces logistical challenges, but the results may not be generalisable to other environments with a different location, business models and case-mix. For example, the record review conducted in the Department of Veterans Affairs, which caters to a population that is predominantly male, may not be generalised to clinic settings and patient populations outside the Veterans Affairs system .
Appropriateness of eye care was generally measured as compliance against scientific evidence or consensus with clinical experts in the field with around two-thirds of the articles having measured eye care appropriateness against recommendations from clinical practice guidelines (n = 38) and 16% having used experts’ opinions (n = 9).
A small number of studies measured eye care appropriateness against expert care rather than against clinical practice guidelines, where the same patients are examined twice, once by the practitioners and once by experts [36, 135, 143].
Eye care appropriateness results are summarized in Table 2. It is important to note at the outset that the timing (e.g. once during a period, at the diagnosis visit, etc.), type of visits (e.g. first visit, follow-up visit, etc.), the health professions and settings assessed, and the method used to collect the data (e.g. record review) vary between studies (see Table 2) and may confound the appropriateness of eye care results.
Twenty-eight studies reporting on eye care appropriateness in glaucoma screening, glaucoma suspects and/or glaucoma patients were included. In more than half of the studies (15 of 28), the appropriateness of glaucoma care was measured via a review of hospital records. Appropriate ‘management’ and ‘recall period’ for glaucoma were reported most of the time, whereas ‘physical examination’ and ‘referral’ for glaucoma were not delivered as appropriately at times (Fig. 3a and b). Overall, the appropriateness of glaucoma care ranged widely from 2 to 100%. The appropriateness of glaucoma care assessed using clinical agreement with experts was the only method where appropriate care was delivered consistently at least 50% of the time. Although studies investigated the appropriateness of glaucoma delivered by optometrists and ophthalmologists, no obvious differences between professions were noted.
Eleven studies have reported on appropriateness of eye care delivery in diabetic patients. Overall, diabetes eye care compliance also ranged widely from 0 to 100%. That wide range and the relatively small number of studies available makes it challenging to detect obvious patterns in individual domains for diabetes care (Fig. 3c and d). For example, only a single study with three quality indicators sampled the appropriateness of ‘patient education’ in diabetes eye care at a single site and reported a below 50% appropriateness of ‘patient education’ overall.
Appropriateness of eye care delivery has been measured for cataract, age-related macular degeneration, preventative eye care and five other ocular conditions in 18 separate articles (Table 2). Eye care appropriateness also ranged widely in those studies, for example from 0 to 100% for dry eye care  and for the referral of cataract surgery .
Very few studies examined or reported on factors that can modulate appropriateness of eye care delivery. Modifiable factors that have been shown to impact appropriateness of eye care delivery include data entry system (i.e. electronic or paper records) , health insurance coverage , higher eye care provider density , awareness of clinical practice guidelines availability , procedural confidence and therapeutic endorsement of optometrists  and specialty training conducted in a supportive environment . Non-modifiable factors that may impact appropriateness of eye care include the severity of patients’ eye condition , patient’s age and ethnicity , and practitioner’s age [72, 129], gender  and years of experience . These factors must therefore be measured and controlled for in any future studies assessing the appropriateness of eye care delivery.
This systematic literature review summarises studies reporting the process of eye care delivery in many different countries using existing published evidence and/or experts’ practice to measure appropriateness of eye care. The appropriateness of eye care delivered was found to vary widely for the most commonly reported conditions (glaucoma and diabetic eye care) from 0 to 100%. Appropriate ‘management’ and ‘recall period’ for glaucoma were observed. Record review was most commonly used to assess the appropriateness of eye care delivery; this may be explained by the ease of administration and low cost associated with this method, especially when conducted at a single site.
The methodological quality was rated as moderate on average across all methods. Different quality assessment tools were used for to appraise studies with different study design, where some criteria were the same between tools. With consideration of the variety of the study designs and the total numbers of included studies, it was considered beneficial to use a modified quality assessment tool with all questions sourced from existing validated critical appraisal tools (Additional file 2). The quality of the included studies should not be different when different tools are used, when the studies are assessed against the same questions from the existing validated critical appraisal tools.
Comparison of the overall appropriateness of eye care versus the appropriateness for individual domains of eye care between studies presented some challenges for the following reasons:
Differences in the number of quality indicators used. Seven quality indicators were used in the Zebardast et al.  study, but 19 quality indicators were used by Ong et al.  Although both studies assessed appropriateness of eye care against the same glaucoma guidelines, the overall result cannot be easily compared, unless this is done by comparing appropriateness of care of individual quality indicators used by both studies.
Differences in eligibility criteria and time frame of quality indicators. Quigley et al.  assessed whether practitioners have performed gonioscopy at least once within the previous 6 years for all patients with open-angle glaucoma and found that appropriate care was delivery only 50% of the time. Conversely, Ong et al.  reported 90% appropriate care for performing gonioscopy on indication. A possible conclusion may be that practitioners in the latter study performed much better than in the former. However, careful observation of the study population characteristics reveals that this appropriateness of care results simply reflects how often practitioners perform gonioscopy in open angle glaucoma in the first instance and use of gonioscopy in cases with a suspicious angle in the latter study.
Differences in time interval. Chawla et al.  assessed both planned and actual review interval for glaucoma against the guidelines whereas Ong et al.  only assessed if the planned follow-up complied with guidelines.
Different aspects of the quality indicator are assessed. Appropriateness of ‘referral’ can be considered in terms of the appropriateness of the referral criteria, the timing of the referral or in terms of the appropriateness and contents of referral letters. Appropriateness of referral often describes whether patients were referred to the correct people or facilities. Appropriateness and contents of referral letters typically considers if the referral letters contained the required information, according to guidelines or specialist’s opinions. However, the percentage of appropriate care of these two aspects may not directly be comparable. Appropriateness of referral pathway or criteria is not necessarily equivalent to an appropriate referral letter and vice versa. For example, Ang et al.  reported that the appropriateness of referral letters from optometrists referring for glaucoma progression was 32% whereas the appropriateness and contents of their referral letters exhibited 24–93% compliance against the seven quality indicators used.
Differences in quality indicator weighing. Most studies weighed all quality indicators evenly, but some assigned different weightings for different quality indicators. Quigley et al.  assigned weighting (0, 1, 2 or 3) according to the imputed importance of individual items. Gupta et al.  defined appropriate care as the practitioners documenting 50% or more of the sub-indicators listed for each element. For example, once 2 or more of the 4 sub-indicators (frequency of deviation, date of onset, and presence of diplopia or squint) of ocular signs and symptoms were documented, this quality indicator was counted as compliant.
The findings of this systematic review are limited by the lack of a standardised method to measure and report the appropriateness of eye care delivery. The extent to which eye care appropriateness may have been under or overestimated may be significantly influenced by the choice of method used to assess care delivery in these studies. Two-thirds of the included articles measured compliance against recommendations from clinical practice guidelines, which are likely to have been developed using similar evidence sources. In this review, this is likely to have manifested as reporting the appropriateness of eye care according to a somewhat narrow evidence base. However, clinical practice guidelines are primarily developed for and made available to clinicians for the purposes of guiding evidence-based care, which lends credibility to their use as a compliance tool. In addition, studies conducted in one country might not reflect the appropriateness of eye care received in a different country where the health care and education systems, values and expectations could be significantly different . Given that and the diversity of countries where eye care appropriateness has been measured, the generalisability of the various reported findings to other countries is uncertain.
Studies reporting the appropriateness of eye care delivery in Australia and other developed mainly English-speaking countries, indicated a wide range of appropriateness of care delivery, for glaucoma and diabetic eye care. Existing eye-related studies have assessed a single condition, a sample from a single centre or a single domain of care even as specific as only one examination technique such as gonioscopy. Consequently, none of the studies identified in the literature review attempted to measure the overall appropriateness of care provided in eye care. One important purpose of measuring appropriateness of care is to help policy makers to allocate limited health resources. Future research would benefit from a more comprehensive approach where appropriateness of eye care delivery is measured across multiple conditions with a single methodology to guide priorities within eye care delivery and monitor quality improvement initiatives.
Availability of data and materials
The datasets generated and/or analysed during the current study are available in the Zenodo repository, DOI: (https://doi.org/10.5281/zenodo.2597710).
Accident and emergency
American Academy of Ophthalmology
Critical Appraisal Skills Programme
Cumulative Index to Nursing and Allied Health Literature
European Glaucoma Society
Effective Public Health Practice Project
Joanna Briggs Institute
National Institute for Health and Clinical Excellence
National Institutes of Health
Preferred Reporting Items for Systematic reviews and Meta-Analyses
United States of America
Pascolini D, Mariotti SP. Global estimates of visual impairment: 2010. Br J Ophthalmol. 2012;96(5):614–8.
Resnikoff S, Keys TU. Future trends in global blindness. Indian J Ophthalmol. 2012;60(5):387–95.
Voleti VB, Hubschman JP. Age-related eye disease. Maturitas. 2013;75(1):29–33.
Konyama K. Essential components of primary eye care. Community Eye Health. 1998;11(26):19–21.
Misra V, Vashist P, Malhotra S, Gupta SK. Models for primary eye care services in India. Indian J Community Med. 2015;40(2):79–84.
Irving EL, Harris JD, Machan CM, et al. Value of routine eye examinations in asymptomatic patients. Optom Vis Sci. 2016;93(7):660–6.
Shah R, Edgar DF, Evans BJ. A comparison of standardised patients, record abstraction and clinical vignettes for the purpose of measuring clinical practice. Ophthalmic Physiol Opt. 2010;30(3):209–24.
Slade SV, Davey CJ, Shickle D. Can data in optometric practice be used to provide an evidence base for ophthalmic public health? Ophthalmic Physiol Opt. 2016;36(4):503–11.
National Health Information Standards and Statistics Committee. The National Health Performance Framework. 2nd ed; 2009.
Claiborne Johnston S, Hauser SL. T2 clinical research: judgment day. Ann Neurol. 2008;63(3):A15–6.
Berg AO, Atkins D, Tierney W. Clinical practice guidelines in practice and education. J Gen Intern Med. 1997;12(Suppl 2):S25–33.
Runciman WB, Hunt TD, Hannaford NA, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197(2):100–5.
McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635–45.
Feussner JR, Kizer KW, Demakis JG. The Quality Enhancement Research Initiative (QUERI): from evidence to action. Med Care. 2000;38(6 Suppl 1):I1–6.
Demakis JG, McQueen L, Kizer KW, Feussner JR. Quality Enhancement Research Initiative (QUERI): A collaboration between research and clinical practice. Med Care. 2000;38(6 Suppl 1):I17–25.
Moher D, Liberati A, Tetzlaff J, Altman DG, Grp P. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Plos Med. 2009;6(7):e1000097.
Access Economics. Clear Focus-The Economic Impact of Vision Loss in Australia in 2009: A Report Prepared by Access Economics Pty Limited. Melbourne: Vision 2020 Australia; 2010.
Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001. JAMA. 2003;289(3):305–12.
Dyba T, Dingsoyr T, Hanssen GK. Applying Systematic Reviews to Diverse Study Types: An Experience Report. In: First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007). Madrid: IEEE Xplore; 2007. p. 225–34.
Critical Appraisal Skills Programme. CASP diagnostic checklist. 2013. 03rd Mar 2017 [cited 2013. Available from: http://www.casp-uk.net/checklists.
National Institutes of Health. Quality Assessment Tool For Observational Cohort And Cross-Sectional Studies. 2014.
Joanna Briggs Institute. JBI Critical Appraisal Checklist For Studies Reporting Prevalence Data. 2014.
Effective Public Health Practice Project. Quality assessment tool for quantitative studies. 2010. 03rd Mar 2017 [cited 2010. Available from: http://www.ephpp.ca/tools.html.
European Glaucoma Society. Terminology and guidelines for Glaucoma. 3rd ed. Savona: Editrice Dogma; 2008.
National Institute for Health and Clinical Excellence. Diagnosis and Management of Chronic Open Angle Glaucoma and Ocular Hypertension. In: NICE Clinical Guideline 85. Manchester: NICE; 2009.
Fung SS, Lemer C, Russell RA, Malik R, Crabb DP. Are practical recommendations practiced? A national multi-Centre cross-sectional study on frequency of visual field testing in glaucoma. Br J Ophthalmol. 2013;97(7):843–7.
Chawla A, Patel I, Yuen C, Fenerty C. Patterns of adherence to NICE glaucoma guidance in two different service delivery models. Eye. 2012;26(11):1412–7.
The College of Optometrists and The Royal College of Ophthalmologists. Guidance on the referral of glaucoma suspects by community optometrists: issued by the College of Optometrists and the Royal College of Ophthalmologist. 2009; updated December 2010.2010. 27th Nov 2017 [cited 2010. Available from: https://www.rcophth.ac.uk/wp-content/uploads/2014/12/2010_PROF_097-Guidance-referral-Glaucoma-suspects-by-optometrists-Dec-2010.pdf.
Khan S, Clarke J, Kotecha A. Comparison of optometrist glaucoma referrals against published guidelines. Ophthalmic Physiol Opt. 2012;32(6):472–7.
College of optometrists. Code of ethics and guidelines for professional conduct, section D3 examining patients at risk from glaucoma. 2011. 07th Jun 2011 [cited 2011. Available from: http://arch.oucs.ox.ac.uk/detail/27747/index.html.
Theodossiades J, Myint J, Murdoch IE, Edgar DF, Lawrenson JG. Does optometrists’ self-reported practice in glaucoma detection predict actual practice as determined by standardised patients? Ophthalmic Physiol Opt. 2012;32(3):234–41.
Stead R, Azuara-Blanco A, King AJ. Attitudes of consultant ophthalmologists in the UK to initial management of glaucoma patients presenting with severe visual field loss: a national survey. Clin Exp Ophthalmol. 2011;39(9):858–64.
General Optical Council. The General Optical Council (injury or disease of the eye and contact lens (qualifications)) (amendment) rules order of council 2005. 2005. 29th Feb 2016 [cited 2005. Available from: http://www.legislation.gov.uk/uksi/2005/1476/made.
College of Optometrists. Framework for optometric referrals. 2005. 29th Feb 2016 [cited 2005. Available from: http://www.college-optometrists.org/membersarea/extranet/OptometricReferrals.pdf.
Scully ND, Chu L, Siriwardena D, Wormald R, Kotecha A. The quality of optometrists' referral letters for glaucoma. Ophthalmic Physiol Opt. 2009;29(1):26–31.
Marks JR, Harding AK, Harper RA, et al. Agreement between specially trained and accredited optometrists and glaucoma specialist consultant ophthalmologists in their management of glaucoma patients. Eye. 2012;26(6):853–61.
Ho S, Vernon SA. Decision making in chronic glaucoma--optometrists vs ophthalmologists in a shared care service. Ophthalmic Physiol Opt. 2011;31(2):168–73.
Shah S, Murdoch IE. NICE - impact on glaucoma case detection. Ophthalmic Physiol Opt. 2011;31(4):339–42.
Syam P, Rughani K, Vardy SJ, et al. The Peterborough scheme for community specialist optometrists in glaucoma: a feasibility study. Eye. 2010;24(7):1156–64.
>Lockwood AJ, Kirwan JF, Ashleigh Z. Optometrists referrals for glaucoma assessment: a prospective survey of clinical data and outcomes. Eye. 2010;24(9):1515–9.
Azuara-Blanco A, Burr J, Thomas R, Maclennan G, McPherson S. The accuracy of accredited glaucoma optometrists in the diagnosis and treatment recommendation for glaucoma. Br J Ophthalmol. 2007;91(12):1639–43.
Patel UD, Murdoch IE, Theodossiades J. Glaucoma detection in the community: does ongoing training of optometrists have a lasting effect? Eye. 2006;20(5):591–4.
Banes MJ, Culham LE, Bunce C, Xing W, Viswanathan A, Garway-Heath D. Agreement between optometrists and ophthalmologists on clinical management decisions for patients with glaucoma. Br J Ophthalmol. 2006;90(5):579–85.
American Academy of Ophthalmology Preferred Practice Pattern Glaucoma Panel. Preferred Practice Pattern®Guidelines. In: Primary Open-Angle Glaucoma. San Francisco: American Academy of Ophthalmology; 2010.
Solano-Moncada F, Dymerska M, Jefferys JL, Quigley HA. Adherence with the use of target intraocular pressure for glaucoma patients in a large university practice. J Glaucoma. 2016;25(4):e424–32.
Elam AR, Blachley TS, Stein JD. Geographic variation in the use of diagnostic testing of patients with newly diagnosed open-angle Glaucoma. Ophthalmology. 2016;123(3):522–31.
American Academy of Ophthalmology Preferred Practice Pattern Glaucoma Panel. Preferred Practice Pattern®Guidelines. In: Primary Open-Angle Glaucoma. San Francisco: American Academy of Ophthalmology; 2005.
Zebardast N, Solus JF, Quigley HA, Srikumaran D, Ramulu PY. Comparison of resident and glaucoma faculty practice patterns in the care of open-angle glaucoma. BMC Ophthalmol. 2015;15:41.
American Academy of Ophthalmology Preferred Practice Pattern Glaucoma Panel. Preferred Practice Pattern®Guidelines. In: Primary Open-Angle Glaucoma. San Francisco: American Academy of Ophthalmology; 2003.
Ong SS, Sanka K, Mettu PS, et al. Resident compliance with the American Academy of Ophthalmology Preferred Practice Pattern guidelines for primary open-angle glaucoma. Ophthalmology. 2013;120(12):2462–9.
Swamy L, Smith S, Radcliffe NM. Optic nerve complex imaging in glaucoma Medicare beneficiaries. Ophthalmic Epidemiol. 2012;19(4):249–55.
Quigley HA, Friedman DS, Hahn SR. Evaluation of practice patterns for the care of open-angle glaucoma compared with claims data: the Glaucoma adherence and persistency study. Ophthalmology. 2007;114(9):1599–606.
American Academy of Ophthalmology Preferred Practice Patterns Committee Glaucoma Panel. Preferred Practice Pattern®Guidelines. In: Primary Angle Closure Glaucoma. San Francisco: American Academy of Ophthalmology; 1996.
Coleman AL, Yu F, Evans SJ. Use of gonioscopy in Medicare beneficiaries before glaucoma surgery. J Glaucoma. 2006;15(6):486–93.
National Health and Medical Research Council. NHMRC guidelines for the screening, prognosis, diagnosis, management and prevention of glaucoma. 2010. 29th Jul 2015 [cited 2010. Available from: https://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/cp113_glaucoma_120404.pdf.
Zangerl B, Hayen A, Mitchell P, Jamous KF, Stapleton F, Kalloniatis M. Therapeutic endorsement enhances compliance with national glaucoma guidelines in Australian and New Zealand optometrists. Ophthalmic Physiol Opt. 2015;35(2):212–24.
European Glaucoma Society. Terminology and guidelines for Glaucoma. 2nd ed. Savona: Editrice Dogma; 2003.
South East Asia Glaucoma Interest Group. Asia Pacific Glaucoma Guidelines. Singapore: South East Asia Glaucoma Interest Group; 2003.
Liu L. Australia and New Zealand survey of glaucoma practice patterns. Clin Exp Ophthalmol. 2008;36(1):19–25.
National Health Service National Service Scotland. General Ophthalmic Services Eye Care. 2006. 29th Feb 2016 [cited 2006. Available from: http://www.isdscotland.org/Health-Topics/Eye-Care/General-Ophthalmic-Services.
El-Assal K, Foulds J, Dobson S, Sanders R. A comparative study of glaucoma referrals in Southeast Scotland: effect of the new general ophthalmic service contract, Eyecare integration pilot programme and NICE guidelines. BMC ophthalmol. 2015;15:172.
Ang GS, Ng WS, Azuara-Blanco A. The influence of the new general ophthalmic services (GOS) contract in optometrist referrals for glaucoma in Scotland. Eye (Lond). 2009;23(2):351–5.
Canadian Ophthalmological Society Glaucoma Clinical Practice Guideline Expert C, Canadian Ophthalmological S. Canadian Ophthalmological Society evidence-based clinical practice guidelines for the management of glaucoma in the adult eye. Can J Ophthalmol. 2009;44(Suppl 1):S7–93.
Cheng J, Beltran-Agullo L, Trope GE, Buys YM. Assessment of the quality of glaucoma referral letters based on a survey of glaucoma specialists and a glaucoma guideline. Ophthalmology. 2014;121(1):126–33.
Vorwerk C, Thelen U, Buchholz P, Kimmich F. Treatment of glaucoma patients with insufficient intraocular pressure control: a survey of German ophthalmologists in private practice. Curr Med Res Opin. 2008;24(5):1295–301.
Weinreb RN, Friedman DS. Angle closure and angle closure Glaucoma: reports and consensus statements of the 3rd global AIGS consensus meeting on angle closure Glaucoma. Amsterdam: Kugler Publications; 2006.
Ang MH, Baskaran M, Kumar RS, et al. National survey of ophthalmologists in Singapore for the assessment and management of asymptomatic angle closure. J Glaucoma. 2008;17(1):1–4.
National Health and Medical Research Council. Guidelines for the Management of Diabetic Retinopathy. Canberra: National Health & Medical Research Council; 2008. Available from: http://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/di15.pdf
Slater J, Chakman J. Referral of diabetic macular oedema by Australian optometrists: comment. Clin Exp Ophthalmol. 2011;39(9):923–4.
National Health and Medical Research Council. Clinical practice guideline: management diabetic retinopathy. 1997. 29th Feb 2016 [cited 1997. Available from: http://www.nhmrc.gov.au/publications/synopses/cp53covr.htm.
Ting DS, Ng JQ, Morlet N, et al. Diabetic retinopathy management by Australian optometrists. Clin Exp Ophthalmol. 2011;39(3):230–5.
Yuen J, Clark A, Ng JQ, et al. Further survey of Australian ophthalmologist's diabetic retinopathy management: did practice adhere to National Health and Medical Research Council guidelines? Clin Exp Ophthalmol. 2010;38(6):613–9.
Aldington SK, Kohner EM, Meuer S, Klein R, Sjølie AK. Methodology for retinal photography and assessment of diabetic retinopathy: the EURODIAB IDDM complications study. Diabetologia. 1995;38:971–5.
Hutchins E, Coppell KJ, Morris A, Sanderson G. Diabetic retinopathy screening in New Zealand requires improvement: results from a multi-Centre audit. Aust N Z J Public Health. 2012;36(3):257–62.
American Diabetes Association. Standards of medical care in diabetes - 2008. Diabetes Care. 2008;31(Suppl 1):S12–54.
Chou CF, Zhang X, Crews JE, Barker LE, Lee PP, Saaddine JB. Impact of geographic density of eye care professionals on eye care among adults with diabetes. Ophthalmic Epidemiol. 2012;19(6):340–9.
American Academy of Ophthalmology Retinal/Vitreous Panel. Preferred Practice Pattern®Guidelines. In: Diabetic Retinopathy. San Francisco: American Academy of Ophthalmology; 2003. 29th Feb 2016.
Tseng VL, Greenberg PB, Scott IU, Anderson KL. Compliance with the American Academy of ophthalmology preferred practice pattern for diabetic retinopathy in a resident ophthalmology clinic. Retina. 2010;30(5):787–94.
Wong MC, Sin CK, Lee JP. The reference framework for diabetes care in primary care settings. Hong Kong Med J. 2012;18(3):238–46.
Wong MCS, Wang HHX, Kwan MWM, et al. The adoption of the Reference Framework for diabetes care among primary care physicians in primary care settings: A cross-sectional study. Medicine. 2016;95(31):e4108.
Ministry of Health. Kingdom of Bahrain. In: Clinical Practice Guidelines on Diabetes Mellitus; 2008. Available from: https://www.moh.gov.sg/content/moh_web/healthprofessionalsportal/doctors/guidelines/cpg_medical.html#withdrawn.
Al-Ubaidi BA, Al-Khadraji MA, Al-Hermi B. Measuring adherence rate to quality indicators for diabetes care identified by primary health care in Bahrain. Saudi Med J. 2014;35(9):975–80.
Philippe J, Brändle M, Carrel J, Diem P, Keller U, Kuntschen F, Ruiz J, Stahl M, Weissenberger B, Spinas GA. Massnahmen zur blutzuckerkontrolle bei patienten mit typ-2-diabetes-mellitus: consensus statement der schweizerischen gesellschaft für endokrinologie. In: Swiss Medical Forum, vol. 9; 2009. p. 50–5.
Burgmann K, Fatio S, Jordi B, Rutishauser J. Medical care of type 2 diabetes mellitus in light of international and national recommendations: a retrospective analysis. Swiss Med Wkly. 2013;143:w13871.
Harkins V. A practical guide to integrated type 2 diabetes care. Dublin: National Health Service Executive; 2008.
Mc Hugh S, Marsden P, Brennan C, et al. Counting on commitment; the quality of primary care-led diabetes management in a system with minimal incentives. BMC Health Serv Res. 2011;11:348.
American Academy of Ophthalmology. Preferred Practice Pattern®Guidelines. In: Diabetic Retinopathy. San Francisco: American Academy of Ophthalmology; 1993.
Preti RC, Saraiva F, Junior JA, Takahashi WY, da Silva ME. How much information do medical practitioners and endocrinologists have about diabetic retinopathy? Clinics (Sao Paulo). 2007;62(3):273–8.
Age-Related Eye Disease Study Research Group. A randomized, placebo-controlled, clinical trial of high-dose supplementation with vitamins C and E, beta carotene, and zinc for age-related macular degeneration and vision loss: AREDS report no. 8. Arch Ophthalmol. 2001;119(10):1417–36.
Age-Related Eye Disease Study 2 Research Group. Lutein + zeaxanthin and omega-3 fatty acids for age-related macular degeneration: the Age-Related Eye Disease Study 2 (AREDS2) randomized clinical trial. JAMA. 2013;309(19):2005–15.
Age-Related Eye Disease Study 2 Research Group. Secondary analyses of the effects of lutein/zeaxanthin on age-related macular degeneration progression: AREDS2 report No. 3. JAMA Ophthalmol. 2014;132(2):142–9.
Musch DC. Evidence for including lutein and zeaxanthin in oral supplements for age-related macular degeneration. JAMA Ophthalmol. 2014;132(2):139–41.
Parodi MB, Zucchiatti I, Cicinelli MV, Cascavilla ML, Bandello F. Nutritional supplementation in age-related macular degeneration. Retina. 2016;36(6):1119–25.
Fletcher AE, Bentham GC, Agnew M, et al. Sunlight exposure, antioxidants, and age-related macular degeneration. Arch Ophthalmol. 2008;126(10):1396–403.
Muhammed S, Yuksel H, Sahin A, et al. Approach of Turkish ophthalmologists to micronutrition in age-related macular degeneration. Arq Bras Oftalmol. 2015;78(1):10–4.
Chakravarthy U, Wong TY, Fletcher A, et al. Clinical risk factors for age-related macular degeneration: a systematic review and meta-analysis. BMC Ophthalmol. 2010;10:31.
Thornton J, Edwards R, Mitchell P, Harrison RA, Buchan I, Kelly SP. Smoking and age-related macular degeneration: a review of association. Eye (Lond). 2005;19(9):935–44.
Mares JA, Moeller SM. Diet and age-related macular degeneration: expanding our view. Am J Clin Nutr. 2006;83(4):733–4.
Evans JR, Lawrenson JG. Antioxidant vitamin and mineral supplements for slowing the progression of age-related macular degeneration. Cochrane Database Syst Rev. 2012;11:CD000254.
Lawrenson JG, Evans JR. Advice about diet and smoking for people with or at risk of age-related macular degeneration: a cross-sectional survey of eye care professionals in the UK. BMC Public Health. 2013;13:564.
Omenn GS, Goodman GE, Thornquist MD, et al. Effects of a combination of beta carotene and vitamin A on lung cancer and cardiovascular disease. N Engl J Med. 1996;334(18):1150–5.
Alpha-Tocopherol Beta Carotene Cancer Prevention Study Group. The effect of vitamin E and beta carotene on the incidence of lung cancer and other cancers in male smokers. N Engl J Med. 1994;330(15):1029–35.
Charkoudian LD, Gower EW, Solomon SD, Schachat AP, Bressler NM, Bressler SB. Vitamin usage patterns in the prevention of advanced age-related macular degeneration. Ophthalmology. 2008;115(6):1032–8 e4.
The Royal College of Ophthalmologists. Cataract Surgery Guidelines. Updated 2007. London: Royal College of Ophthalmologists; 2004.
Gomaa A, Liu C. Nd:YAG laser capsulotomy: a survey of UK practice and recommendations. Eur J Ophthalmol. 2011;21(4):385–90.
College of Optometrists. Framework for the optometric co-management of patients with cataracts. 2003.
Park JC, Ross AH, Tole DM, Sparrow JM, Penny J, Mundasad MV. Evaluation of a new cataract surgery referral pathway. Eye. 2009;23(2):309–13.
National Health Service Executive. Action on cataracts. Good practice guidance. London: Department of Health; 2000. Available from: https://www.rcophth.ac.uk/wp-content/uploads/2015/03/Action-on-cataracts-Jan-2000-dh_4014514.pdf
Lash SC, Prendiville CP, Samson A, Lewis K, Munneke R, Parkin BT. Optometrist referrals for cataract and "action on cataracts" guidelines: are optometrists following them and are they effective? Ophthalmic Physiol Opt. 2006;26(5):464–7.
American Academy of Ophthalmology Cataract and Anterior Segment Panel. Preferred Practice Pattern®Guidelines. In: Cataract In The Adult Eye. San Francisco: American Academy of Ophthalmology; 2006.
Niemiec ES, Anderson KL, Scott IU, Greenberg PB. Evidence-based management of resident-performed cataract surgery: an investigation of compliance with a preferred practice pattern. Ophthalmology. 2009;116(4):678–84.
College of Optometrists. What happens in an eye examination? Available from: www.collegeoptometrists.org/index.aspx/pcms/site.Public_Related_Links.The_eye_examination.What_Happens_in_/.
Association of Optometrists. The eye examination. 2008. 25th Apr 2008 [cited 2008. Available from: www.assoc-optometrists.org.
College of Optometrists. Code of ethics and guidelines for professional conduct. 2008. 27th May 2008 [cited 2008. Available from: http://www.college-optometrists.org/index.aspx/pcms/site.publication.Ethics_Guidelines.recent.
Shah R, Edgar DF, Spry PG, et al. Glaucoma detection: the content of optometric eye examinations for a presbyopic patient of African racial descent. Br J Ophthalmol. 2009;93(4):492–6.
National Health Service. The General Ophthalmic Services contracts regulations 2008. 2008. 05th May 2016 [cited 2008. Available from: http://www.pcc.nhs.uk/uploads/Optometry/May%2008/gos_contracts_regs_2008.pdf.
Harvey BF. Routine eye examination. London: Elsevier; 2005.
Shah R, Edgar DF, Harle DE, et al. The content of optometric eye examinations for a presbyopic patient presenting with symptoms of flashing lights. Ophthalmic Physiol Opt. 2009;29(2):105–26.
General Optical Council. Annual report; 2008. p. 1–44. 01st Jul 2016 Cited 2008. Available from: http://www.optical.org/goc/filemanager/root/site_assets/publications/annual_reports/GOC_RepAcc07_2.pdf
Shah R, Edgar DF, Rabbetts R, et al. The content of optometric eye examinations for a young myope with headaches. Ophthalmic Physiol Opt. 2008;28(5):404–21.
Christen WG, Manson JE, Seddon JM, et al. A prospective study of cigarette smoking and risk of cataract in men. JAMA. 1992;268(8):989–93.
Hankinson SE, Willett WC, Colditz GA, et al. A prospective study of cigarette smoking and risk of cataract surgery in women. JAMA. 1992;268(8):994–8.
Klein R, Klein BE, Linton KL, DeMets DL. The beaver dam eye study: the relation of age-related maculopathy to smoking. Am J Epidemiol. 1993;137(2):190–200.
Seddon JM, Willett WC, Speizer FE, Hankinson SE. A prospective study of cigarette smoking and age-related macular degeneration in women. JAMA. 1996;276(14):1141–6.
Age-Related Eye Disease Study Research Group. The relationship of dietary carotenoid and vitamin A, E, and C intake with age-related macular degeneration in a case-control study: AREDS Report No. 22. Arch Ophthalmol. 2007;125(9):1225–32.
Seddon JM, Ajani UA, Sperduto RD, et al. Dietary carotenoids, vitamins A, C, and E, and advanced age-related macular degeneration. Eye Disease Case-Control Study Group. JAMA. 1994;272(18):1413–20.
Augood C, Chakravarthy U, Young I, et al. Oily fish consumption, dietary docosahexaenoic acid and eicosapentaenoic acid intakes, and associations with neovascular age-related macular degeneration. Am J Clin Nutr. 2008;88(2):398–406.
Merle BM, Delyfer MN, Korobelnik JF, et al. High concentrations of plasma n3 fatty acids are associated with decreased risk for late age-related macular degeneration. J Nutr. 2013;143(4):505–11.
Downie LE, Keller PR. The Self-Reported Clinical Practice Behaviors of Australian Optometrists as Related to Smoking, Diet and Nutritional Supplementation. Plos One. 2015;10(4):e0124533.
Management and Therapy Subcommittee of the International Dry Eye WorkShop. Management and therapy of dry eye disease: report of the management and therapy Subcommittee of the International dry eye WorkShop (2007). Ocul Surf. 2007;5(2):163–78.
Diagnostic Methodology Subcommittee of the International Dry Eye Workshop. Methodologies to diagnose and monitor dry eye disease: report of the diagnostic methodology Subcommittee of the International dry eye WorkShop (2007). Ocul Surf. 2007;5(2):108–52.
Downie LE, Keller PR, Vingrys AJ. An evidence-based analysis of Australian Optometrists' dry eye practices. Optom Vis Sci. 2013;90(12):1385–95.
American Academy of Ophthalmology. Preferred Practice Pattern®Guidelines. In: Dry Eye Syndrome. San Francisco: American Academy of Ophthalmology; 1998.
Lin IC, Gupta PK, Boehlke CS, Lee PP. Documentation of conformance to preferred practice patterns in caring for patients with dry eye. Arch Ophthalmol. 2010;128(5):619–23.
Hau S, Ehrlich D, Binstead K, Verma S. An evaluation of optometrists' ability to correctly identify and manage patients with ocular disease in the accident and emergency department of an eye hospital. Br J Ophthalmol. 2007;91(4):437–40.
Repka MX, Beck RW, Holmes JM, et al. A randomized trial of patching regimens for treatment of moderate amblyopia in children. Arch Ophthalmol. 2003;121(5):603–11.
Holmes JM, Kraker RT, Beck RW, et al. A randomized trial of prescribed patching regimens for treatment of severe amblyopia in children. Ophthalmology. 2003;110(11):2075–87.
Jin YP, Chow AHY, Colpa L, Wong AMF. Clinical translation of recommendations from randomized clinical trials on patching regimen for amblyopia. Ophthalmology. 2013;120(4):657–62.
American Academy of Ophthalmology. Preferred Practice Pattern®Guidelines. In: Esotropia. San Francisco: American Academy of Ophthalmology; 2002.
Gupta PK, Freedman SF, Lee PP. Conformance with preferred practice patterns in caring for children with esotropia. J Pediatr Ophthalmol Strabismus. 2010;47(3):145–9 quiz 50-1.
Jabs DA, Nussenblatt RB, Rosenbaum JT. Standardization of Uveitis Nomenclature (SUN) Working Group. Standardization of uveitis nomenclature for reporting clinical data. Results of the First International Workshop. Am J Ophthalmol. 2005;140(3):509–16.
Nguyen QD, Hatef E, Kayen B, et al. A cross-sectional study of the current treatment patterns in noninfectious uveitis among specialists in the United States. Ophthalmology. 2011;118(1):184–90.
Andonegui J, Zurutuza A, de Arcelus MP, et al. Diabetic retinopathy screening with non-mydriatic retinography by general practitioners: 2-year results. Prim Care Diabetes. 2012;6(3):201–5.
Schoen C, Osborn R, Doty MM, Bishop M, Peugh J, Murukutla N. Toward higher-performance health systems: adults' health care experiences in seven countries, 2007. Health Aff (Millwood). 2007;26(6):w717–34.
We thank UNSW Library, Academic Services Team for their contribution on reviewing the search strategy and conducting the test run.
This work was supported by a UNSW Sydney Tuition Fee Scholarship [to KCH]; the Saudi Arabian Ministry of Higher Education [to SA]; a UNSW Sydney Faculty of Science June Griffith Fellowship [to IJ]; and a UNSW Sydney Faculty of Science Research Program Grant. The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1:
Full electronic search strategy for Medline. (DOCX 15 kb)
Additional file 2:
Quality assessment tool. (DOCX 22 kb)
Additional file 3:
Results of quality appraisal of included studies. (DOCX 52 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Ho, K.C., Stapleton, F., Wiles, L. et al. Systematic review of the appropriateness of eye care delivery in eye care practice. BMC Health Serv Res 19, 646 (2019). https://doi.org/10.1186/s12913-019-4493-3
- Delivery of health care
- Diabetic retinopathy
- Public health
- Evidence-based practice
- Process assessment (health care)