Geographical variation in radiological services: a nationwide survey
© Lysdahl and Børretzen; licensee BioMed Central Ltd. 2007
Received: 23 June 2006
Accepted: 15 February 2007
Published: 15 February 2007
Geographical variation in health care services challenges the basic principle of fair allocation of health care resources. This study aimed to investigate geographical variation in the use of X-ray, CT, MRI and Ultrasound examinations in Norway, the contribution from public and private institutions, and the impact of accessibility and socioeconomic factors on variation in examination rates.
A nationwide survey of activity in all radiological institutions for the year 2002 was used to compare the rates per thousand of examinations in the counties. The data format was files/printouts where the examinations were recorded according to a code system.
Overall rates per thousand of radiological examinations varied by a factor of 2.4. The use of MRI varied from 170 to 2, and CT from 216 to 56 examinations per 1000 inhabitants. Single MRI examinations (knee, cervical spine and head/brain) ranged high in variation, as did certain other spine examinations. For examination of specific organs, the counties' use of one modality was positively correlated with the use of other modalities. Private institutions accounted for 28% of all examinations, and tended towards performing a higher proportion of single examinations with high variability. Indicators of accessibility correlated positively to variation in examination rates, partly due to the figures from the county of Oslo. Correlations between examination rates and socioeconomic factors were also highly influenced by the figures from this county.
The counties use of radiological services varied substantially, especially CT and MRI examinations. A likely cause of the variation is differences in accessibility. The coexistence of public and private institutions may be a source of variability, along with socioeconomic factors. The findings represent a challenge to the objective of equality in access to health care services, and indicate a potential for better allocation of overall health care resources.
The data applied in this article was originally published in Norwegian in: Børretzen I, Lysdahl KB, Olerud HM: Radiologi i Noreg – undersøkingsfrekvens per 2002, tidstrendar, geografisk variasjon og befolkningsdose. StrålevernRapport 2006:6. Østerås: The Norwegian Radiation Protection Authority. The Norwegian Radiation Protection Authority has given the authors permission to republish the data.
Geographical variation in use of radiology has been documented in the United States [1–3], in Europe , and in the Nordic countries, where a factor of 1.8 in variation between the countries was reported . When areas differ with respect to available economic resources, health care policies, referral systems, and reimbursement policies, then geographical variation can be expected. In Norway the health care system is predominantly public, and the National Insurance Scheme covers the vast majority of radiology services (including private radiology services), that is when patients obtain a referral from their physician (GP or specialist).
In an earlier study differences in use rates of radiology were observed between urban and rural areas in Norway, but the differences were not quantified . To determine the presence and magnitude of variability of radiology is important with respect to the question of equal access to health care, which is a declared objective in Norwegian health policy (as in most other countries), and stated in The Patients' Rights Act . Moreover, such data is valuable with respect to the question of allocation of overall health care resources, especially as radiology is a costly discipline, and expenditure on radiology is steadily increasing . Although the question of the correct or reasonable level of utilization cannot be answered through small area variation analysis, a significant variation in otherwise homogeneous areas may indicate that use of radiological services, at least in some areas, is not optimal [2, 5]; that is, that underuse or overuse occurs.
The aim of this study was to determine the use rates of radiology in Norwegian counties. Variation in overall and modality specific examination rates, i.e. X-ray (XR), Computed Tomography (CT), Magnetic Resonance Imaging (MRI) and Ultrasound (US), was analysed, as well as variability in clustered and single examinations. (In this study, XR includes conventional radiography, fluoroscopy, mammography, angiography and interventional procedures). In addition, the following hypotheses were investigated: a) counties with low use of one modality for examination of specific organs (locations) have correspondingly high use of other modalities, b) private institutions contribute to geographical variation, and geographical variation in examination rates is influenced by c) different aspects of accessibility and d) socioeconomic factors.
The Norwegian Radiation Protection Authority (NRPA) has conducted a nationwide survey to determine the frequency of radiological examinations during the year 2002. All medical radio-diagnostic procedures are included except dental examinations, nuclear medicine, bone densitometry and radiology in chiropractic settings and primary health care services. Activity data were received from all addressed entities (referred to as institutions in the following); 71 public and 9 private hospitals, 25 mammography screening laboratories and 25 private radiology enterprises. According to NRPA's registers these include all relevant institutions in 2002, hence the results are based on a complete count of the included examinations (not a sample survey).
The requested data format was files or printout from the Radiology Information Systems (RIS), where examinations are recorded according to the Norwegian Radiological Codes system (NORAKO) . This system provides detailed information on the organ/organ system/anatomical region examined (location code), the modality used (modality code), the type of procedure to characterise/specify the examination (procedure code). Codes for right, left, or bilateral examination (side code) and codes for additional information (such as anaesthesia) are also included.
Of the 130 institutions, 13 did not report in the requested format. For 5 of these, the examinations were coded manually on the basis of received descriptive texts. For 8 (small) institutions that reported on examination group level (e.g. number of skeleton X-rays), average distributions for similar institutions were used to estimate the distribution of localization codes within each group.
The main adjustments carried out concern estimation of number of examinations from the number of codes. Since the codes are primarily used for reimbursement purposes, activities reflecting resources utilized in the examinations need to be specified. Consequently, one examination can generate more than one code. In general, codes were deleted when they did not represent an examination; either as stated explicitly by the institution (e.g. reinterpretation of radiographs) or by the user manual prepared by the Norwegian College of Radiology . Procedure codes for additional series were deleted, except for six institutions where coding had clearly not been carried out in accordance with the manual. This adjustment has reduced the number of CT and angiography codes by 7.7% and 8.7% respectively, while 40% of the MRI codes were deleted. Moreover, in CT examinations 7.8% of the intravenous contrast (IV) codes were deleted to eliminate double coding (of examinations both with and without IV). This adjustment was estimated based on a previous survey of CT examination techniques . In X-ray examinations (other than angiography) the number of codes was assumed to be equal to the actual number of examinations, due to a low probability of any kind of double coding. A more detailed description of the method is to be found in an extended report .
County was the entity used in the geographical variation analyses, based on the assumption that institutions mainly serve inhabitants in their own county. For mammography screening this was not the case; three screening laboratories provided services in two counties each. Consequently, these data were distributed according to the number of inhabitants in the respective counties. Moreover, for two large hospitals situated in Oslo (the Norwegian Radium Hospital Comprehensive Cancer Centre and Rikshospitalet University Hospital) the majority of the patients reside outside Oslo (close to 90%). Detailed information on patients' residential county and the corresponding number of examinations per modality was provided, and formed the basis for distributing these data.
Indicators of accessibility and socioeconomic status
The reported data on number of examinations are not linked to individual patients, hence correlations between examination rates and variables of accessibility and socioeconomic factors are provided on an aggregated level. Information on settlement characteristics (population density, percentage of urban settlements) and number of radiographers employed in the counties were obtained from Statistics Norway , while number of working radiologist in each county was obtained from The Norwegian Medical Association (on personal request). In addition the proportion of the counties population living in municipalities with general radiological services was calculated. This calculation was based on number of inhabitants in each municipality (the 19 counties are divided in to 434 smaller municipalities) and information of location of general radiological services (delimited by excluding mammography screening facilities and specialised rehabilitation and heart disease hospitals). This measure was applied to assess the impact of proximity, i.e. whether a high percentage of a county's population living in a municipality where a radiological provider exists could explain high examination rates. Socioeconomic information (average gross income for persons 17 years of age and over, and number of persons with tertiary or postgraduate level of education per 1000 inhabitants) was also obtained from Statistics Norway. The linked table displays figures of settlement characteristic, radiological resources and socioeconomic factors in the counties (see Additional file 1).
Geographical variation is presented as rates (number of examination per 1000 inhabitants) in each county, high/low ratio for rates (an easily comprehensible measure), and the more accurate variation measure coefficient of variation (COV, which is defined as standard deviation relative to mean rate value). Pearson's r describes correlations. Statistical significance analyses is performed even though the results are based on complete count, seeing the year 2002 data as a sample of the true values that varies randomly across years.
The overall reported rate per thousand of radiological examinations in Norwegian counties in 2002 varies by a factor of 2.4. The rate was highest in Oslo (the capital and the most densely populated county) and lowest in Finnmark (the most distant and sparsely populated county): 1487 and 613 examinations per 1000 inhabitants respectively. The linked map displays the location of the counties (see Additional file 2).
Number of examinations per 1000 inhabitants1 according to modality and county in 2002, with high/low ratio and coefficient of variation (COV)2
Møre og Romsdal
Sogn og Fjordane
When examinations were clustered according to the region of the body (irrespective of the modality used), the highest variability was seen for spine examinations (COV: 39%, high/low ratio: 4.3). The least variation was found for 'chest' examinations (COV: 18%, high/low ratio 1.9). Medium variation was found for 'pelvis, urinary tract and genitalia', 'head', 'mammae', 'abdominal and gastrointestinal' 'extremities' (COV between 34% and 24%, high/low ratio between 3.9 and 2.2).
Geographical variation in number of single examinations1 per 1000 inhabitants, in the counties with highest and lowest values, high/low ratio and COV within counties
MRI Cervical spine
XR Lumbar spine
US Upper urinary tract
CT Lumbar spine
XR Lumbar spine with sacrum
XR Cervical spine
XR Thorax, front
XR Thoracic spine
XR Urinary tract/urography
XR Lower leg
XR Thorax, two projections
Correlations between different modalities
Correlations (Pearson's r) between examination rates according to modality1 within counties
XR and CT
XR and MRI
XR and US
CT and MRI
CT and US
MRI and US
Contribution from private and public institutions
The impact of accessibility
The impact of socioeconomic factors
Two socioeconomic variables were used in this study; the number of persons with tertiary or postgraduate level of education per thousand inhabitants and the average gross income. The educational level variable correlated positively to overall examination rates (Pearson's r = 0.59, p = .008), while the income correlation was not significant (Pearson's r = 0.45, p = .056). Again the influence of Oslo was striking: the correlations vanished when the county of Oslo was not included in the analyses (r = 0.05 and 0.008 respectively). In Oslo the gross income level and the number of persons with highest level of education was a factor 1.3 and 1.8 above mean values in the counties respectively.
The geographical variation in use of radiology was significant, not least as Norway traditionally is considered to be an egalitarian society where great emphasis has been placed on equal access to health care services. Most studies of variation rates in radiology are limited to single examinations and/or limited to particular populations. Hence, it is difficult to assess the level of overall variation found in our study compared to other studies. However, our study is very much in line with results from studies of geographical variations with regard to particular modalities, such as CT and MRI .
Validity of the data
The chosen data format was considered appropriate, as almost all institutions used the same coding system (NORAKO), it was convenient for the institutions and secured both a complete response rate and a uniform format. Nevertheless, some methodological considerations need to be discussed. The main challenge concerns estimation of the number of examinations from the number of codes. After deletion of codes that only described details about how the examinations were performed, we regard the number of examinations as almost correct. The exception is angiography/interventional procedures (and to a small extent ultrasound examinations) where data were not adjusted for the use of several location codes within a single examination. This means that the total rates per thousand was overestimated. However, the possible effect on geographical variation is small since angiography/interventional procedures accounted for only 2% of all XR examinations. If the estimation deviates in any other way from the real number of examinations, this would have a minor influence on geographical variation, as all institutions were treated in an equal manner. It could be argued that this presupposes that all institutions used the coding system in exactly the same way. When coding practice was scrutinised some differences between the institutions were discovered, possibly due to somewhat ambiguous guidelines. However, there were no systematic differences between the counties.
Migration as a cause of geographical variation
One obvious challenge to validity is patient migration (from one county to another). For two large hospitals (both situated in Oslo) examinations were distributed according to patients' home county. Nevertheless, patient migration may take place in other institutions and be a challenge to validity. Factors reflecting different aspects of accessibility could influence migration, e.g. that the requested examination is not available in the patient's home county, or that waiting times or travelling distances are shorter in a neighbouring county. This effect certainly explains some of the differences between Oslo, and the surrounding county of Akershus. However, the merged rate per thousand for these two counties was still high. In many other parts of the country the travel distances are long and inconvenient. Exact information on patient migration in radiology is sparse, but data from one private institution in each of three counties showed that 85%, 95% and 98% of the patients lived in the county where the institution was located . Indirect information is given by the fact that the number of patients who choose to be treated (in general, not limited to radiology) outside their local hospital in 2002 was small . Free choice of hospital was implemented in Norway in 2001. All in all the problem of migration of patients may have caused that the variations found in this study are slightly overestimated.
Variation caused by differences in accessibility
Availability is a well known factor for explaining variation in utilization rates for radiology [16, 17], and probably contributes to the high variability of MRI and CT examinations and the strikingly high rates in Oslo (although burdened with some methodological uncertainties) found in this study. The county of Oslo is atypical, since it comprises the city and its suburbs; a highly urbanized area, with short distances to services, with large university hospitals and high availability of new high-technology imaging facilities. All these factors are associated with high use of radiology [1, 17]. The radiological institutions in the counties differ in relation to size, the amount of CT and MRI equipment, and maybe also in practice pattern. Aroua  found that the rate of chest radiography (a simple examination available "everywhere") was almost three times higher in university hospitals than in small hospitals in Switzerland. Our study also reveals geographical variation in this "low-tech" examination. The acquisition of new technology – which occurs first in larger urban institutions – may lead to additional examinations if (as implied by Olsson ) willingness to give up outdated methods varies. This mechanism corresponds well with the correlation that was found between utilization of different modalities for specific organs (locations).
The special position of Oslo was confirmed by the analyses of correlation between different aspects of accessibility and overall examination rates which were markedly influenced by extreme values in this county. It seems somewhat surprising that radiological resources (number of radiologists and radiographers) was not stronger related to examination rates in the other counties. The correlation between examination rates and the proportion of the counties population living in municipalities with radiological services was high even without Oslo's contribution. On this variable the eight counties with lowest score corresponded to the eight with lowest examination rates. In the opposite end of the scale was Østfold and Telemark, in these counties a large proportion of the population lived in municipalities with radiological services, and had correspondingly high examination rates. An interesting difference in examination rates (75%) was found between Telemark and Oppland, two counties with similar population size and radiological resources. Both the population density and the proportion of urban settlement were lower in Oppland than in Telemark, but most noteworthy 68% of the population in Telemark lived in municipalities with radiological services compared with 28% in Oppland. These findings support the importance of proximity to services as explaining factor. One possible interpretation is that in areas with poor access patients (and their GPs) regard the usefulness of the examination as small in relation to the inconvenience (travelling etc) it causes. In this case the necessity of the examination cannot be perceived to be pressing. This interpretation is reasonable in the light of the kind of examinations that vary the most. For example, in cases of knee, shoulder or back pain, which often resolves with time and which does not often represents a severe or life-threatening disease, a "wait and see" approach might be more common if access to radiology is poor.
Other sources of variability
Other frequently stated explanatory factors are socioeconomic differences in the populations [1, 16–18] and economic factors . In this study the educational and income level was found to have little impact on examination rates, but these results must be interpreted with caution, as the variations in socioeconomic factors are considered to be higher within than between counties. However, in Oslo the level of education and average income was clearly above mean values in the counties. People with higher socioeconomic status and higher education are presumed to use medical care more readily and to demand more elective services. Ordering an imaging test may be a response to high patient expectation, especially when combined with constrained time resources . In a Norwegian survey, about 50% of the physicians occasionally or often gave priority to patients' wishes over their own medical judgement . Hence, patient pressure is a major factor influencing GPs' referral behaviour. For example, Morgan et al  found that patient pressure was the main factor or a significant factor in 46% of knee radiograph referrals. Closely linked to this are two other factors that influence referral decisions: professional uncertainty [1, 23] and medico-legal considerations. Kristiansen et al  found that the likelihood of having experienced negative reactions from patients was higher among doctors in central Norway.
Economic incentives can affect both the referring and performing physician/institution. The density of GPs is higher in urban areas. How this affects referral patterns when remuneration is based on a per capita component and a fee-for-service component is ambiguous. GPs may compensate for shortage of patients by providing more services to each patient . On the other hand, they might act more in compliance with patients' wishes for radiology, to keep patients on their lists.
Some GPs report that they refer patients to private radiological institutions when the purpose is mostly to satisfy patients' wishes, while in cases of high probability of positive findings they refer to the hospital . They assume that they would have referred fewer patients if private institutions had not been available. This may be because hospitals practise referral guidelines more strictly than private practices, as indicated (in general) by Iversen and Lurås . The finding that the proportion of contribution from private institutions was correlated to the variability in single examinations is interesting in this context. Besides, the kind of examinations for which both the contribution from private institutions and the variability was high fits well into this picture: examinations for which justification is controversial, e.g. knee  and spine [26, 27], and for which serious disease is seldom revealed. Private radiological institutions are located in the large towns, 1/3 in the city of Oslo. When both private and pubic sectors are established in the same region, it is crucial for the overall radiological activity in the region whether they compete or complement each other. If this is the case is an open question.
The fact that high rates of use do not necessarily improve patient outcome [2, 28], raises the question of whether geographical variation in radiological services reflects inappropriate use. Geographical variation in user rates for medical services does not determine the appropriateness of the services , in order to determine what constitutes overuse and underuse, data on variation must be linked to information on indications, clinical outcome, risks and costs. Analyses of clinical outcome were far beyond the scope of this study. Neither was it possible to perform quantitative analyses of variation in morbidity as explaining factor for variation in examination rates due to lack of available statistics. The nationwide health survey available are either limited to age groups or specific diagnoses that can not be easily linked to use of radiological services (e.g. cardiovascular disease and diabetes) or they are not representative on the county level. Such analyses could indirectly have illuminated the question of appropriateness of the use of radiological services in the counties. According to Leape et al inappropriate use occurs in low-use areas as well as in high-use areas . Even though, in industrialised countries today, we cannot ignore the problem of patients who are referred too late or not at all [3, 29], the problem of unnecessary examinations appears to be more pertinent [22, 26, 31, 32]. Indications of supplementary examinations found in this study, that high use of one modality does not correspond with low use of an alternative modality for specific organs (locations), support the assumption that overuse exists in high-use areas. The lack of a substitution effect of one type of imaging for another has also been found in other studies, i.e. areas with higher rates of one type of imaging also had higher rates of another type . The question of possible overtesting is crucial to address if we want to avoid or to minimise rationing of care to sick patients , as radiology is a costly enterprise , and overall health care resources are limited. Neglect of this issue leads to a risk of unjust diversion of resources from sick people to people who are worried but healthy.
There was substantial geographical variation in use rates of radiology in Norway, especially for MRI and CT examinations. Accessibility seems to be a plausible explanation, besides socioeconomic factors and the contribution from private institutions may play a part. The study was not designed to verify/disprove overuse or underuse of radiology. However, characteristics of examinations with high variability and indications of supplementary examinations mean that overuse cannot be ruled out, but neither can underuse. We believe that the findings reveal a potential for more equal access to radiological services and for better allocation of overall health care resources.
The authors wish to thank Hilde M. Olerud (The Norwegian Radiation Protection Authority) and Bjørn Hofmann (University of Oslo) for helpful advice and discussions, valuable comments on earlier drafts, and continuous support throughout the development of this paper.
For this study KBL has received funding from Oslo University College. For IB this work was included in her job as employee at The Norwegian Radiation Protection Authority (NRPA). NRPA was the responsible addressee of the activity data from the radiological entities/institutions. The funding bodies of the study had no further role in study design, data collection, data analysis, data interpretation or writing of the manuscript. NRPA has approved to submit the manuscript for publication.
- Rao VM, Parker L, Levin DC, Sunshine J, Bushee G: Use trends and geographic variation in neuroimaging: Nationwide medicare data for 1993 and 1998. AJNR Am J Neuroradiol. 2001, 22: 1643-1649.PubMedGoogle Scholar
- Lurie JD, Birkmeyer NJ, Weinstein JN: Rates of advanced spinal imaging and spine surgery. Spine. 2003, 28 (6): 616-620. 10.1097/00007632-200303150-00018.PubMedGoogle Scholar
- Garg PP, Landrum MB, Normand SL, Ayanian JZ, Hauptman PJ, Ryan TJ, McNeil BJ, Guadagnoli E: Understanding individual and small area variation in the underuse of coronary angiography following acute myocardial infarction. Med Care. 2002, 40 (7): 614-626. 10.1097/00005650-200207000-00008.View ArticlePubMedGoogle Scholar
- Aroua A, Bize R, Buchillier-Decka I, Vader JP, Valley JF, Schnyder P: X-ray imaging of the chest in Switzerland in 1998: a nationwide survey. Eur Radiol. 2003, 13 (6): 1250-9.PubMedGoogle Scholar
- Olsson S, Piene H, Staf P, Kormano M, Svedstrom E, Boijsen E, Lindgren PG, Persson R, Danneskiold-Samsoe B, Georgsson G: Radiology in the Nordic Countries. Comput Methods Programs Biomed. 1999, 36 (2–3): 93-97.Google Scholar
- Olerud HM: Røntgenundersøkelser i Norge – optimalisert strålebruk og strålvern (X-ray examinations in Norway – optimized use of radiation and radiation protection). Tidsskr Nor Laegeforen. 1999, 119 (9): 1322-5.PubMedGoogle Scholar
- Act of 2. July 1999 no. 63 relating to Patients' Rights. Oslo: Ministry of Health and Social Affaires. [http://www.regjeringen.no/upload/kilde/hod/red/2005/0079/ddd/pdfv/242636-patients'_rights_act.pdf]
- Helsedepartementet: St.meld. nr. 5 (2003–2004) Inntekstsystem for spesialisthelsetjenesten, kap.5. (The Ministry of Health: White paper no. 5 2002–2004. Revenue system for secondary health services, cap.5). [http://odin.dep.no/hod/norsk/dok/regpubl/stmeld/042001-040004/dok-bn.html]
- Norsk radiologisk forening, NORAKO Norsk radiologisk kodeverk. 1.1. (Norwegian Society of Radiology, Norwegian radiological code system). 2002, Trondheim: KITHGoogle Scholar
- Olerud HM, Finne IE: Computer-tomografi ved norske sykehus. Undersøkelsesteknikk og stråledose til pasient. (Survey of CT practice in Norway. Examination technique and patient doses). StrålevernRapport. 1995, Østerås: Norwegian Radiation Protection Authority, 11-[http://www.nrpa.no/archive/Internett/Publikasjoner/Stralevernrapport/1995/StralevernRapport_11_1995.pdf]Google Scholar
- Børretzen I, Lysdahl KB, Olerud HM: Radiologi i Noreg – undersøkingsfrekvens per tidstrendar, geografisk variasjon og befolkningsdose. (Radiology in Norway – examination frequency per 2002, trends in time, geographical variation and population dose). StrålevernRapport. 2006, Østerås: Norwegian Radiation Protection Authority, 6-[http://www.nrpa.no/archive/Internett/Publikasjoner/Stralevernrapport/2006/StralevernRapport_6_2006.pdf]Google Scholar
- Statistics Norway. [http://www.ssb.no/]
- Olsson S: Diffusion, utilization and regional variation in the use of CT and MRI in Sweden. Comput Methods Programs Biomed. 2001, 66: 129-35. 10.1016/S0169-2607(01)00155-9.View ArticlePubMedGoogle Scholar
- Sentrum Røntgeninstitutt. Årsrapport(Annual report 2002). 2002Google Scholar
- Kalseth J, (Ed): SAMDATA Sykehus Rapport. Utviklingen i helseregionene etter sykehusreformen, rapport nr. 4. (SAMDATA Hospital report. Development within the health regions after the health care reform, report no. 4). 2003, Trondheim: SINTEF Unimed Helsetjenesteforskning, [http://www.sintef.no/project/Samdata/rapporter/SAMDATA_Sykehus_rapport_2002.pdf]
- Goel V, Iron K, Williams JI: Enthusiasm or uncertainty: small area variations in the use of mammography services in Ontario, Canada. J Epidemiol Community Health. 1997, 51 (4): 378-382.View ArticlePubMedPubMed CentralGoogle Scholar
- Alter DA, Naylor CD, Austin PC, Chan BT, Tu JV: Geography and service supply do not explain socioeconomic gradients in angiography use after acute myocardial infarction. Can Med Assoc J. 2003, 168 (3): 261-264.Google Scholar
- Ackerman SJ, Steinberg EP, Bryan RN, BenDebba M, Long DM: Patient characteristics associated with diagnostic imaging evaluation of persistent low back problems. Spine. 1997, 22 (14): 1634-1640. 10.1097/00007632-199707150-00021.View ArticlePubMedGoogle Scholar
- Burkhardt JH, Sunshine JH: Utilization of radiologic services in different payment systems and patient populations. Radiology. 1996, 200 (1): 201-207.View ArticlePubMedGoogle Scholar
- Freeborn DK, Shye D, Mullooly JP, Eraker S, Romeo J: Primary care physicians' use of lumbar spine imaging tests: effects of guidelines and practice pattern feedback. J Gen Intern Med. 1997, 12 (10): 619-625. 10.1046/j.1525-1497.1997.07122.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Gulbrandsen P, Forde R, Aasland OG: Hvordan har legen det som portvakt? (What does it feel like to be a gatekeeper?). Tidsskr Nor Laegeforen. 2002, 122 (19): 1874-1879.PubMedGoogle Scholar
- Morgan B, Mullick S, Harper WM, Finlay DB: An audit of knee radiographs performed for general practitioners. Br J Radiol. 1997, 70: 256-260.View ArticlePubMedGoogle Scholar
- Espeland A, Baerheim A: Factors affecting general practitioners' decisions about plain radiography for back pain: implications for classification of guideline barriers – a qualitative study. BMC Health Serv Res. 2003, 3: 8-10.1186/1472-6963-3-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Kristiansen IS, Forde OH, Aasland O, Hotvedt R, Johnsen R, Forde R: Threats from patients and their effects on medical decision making: a cross-sectional, randomised trial. Lancet. 2001, 357 (9264): 1258-1261. 10.1016/S0140-6736(00)04407-X.View ArticlePubMedGoogle Scholar
- Iversen T, Luras H: The effect of capitation on GPs' referral decisions. Health Econ. 2000, 9 (3): 199-210. 10.1002/(SICI)1099-1050(200004)9:3<199::AID-HEC514>3.0.CO;2-2.View ArticlePubMedGoogle Scholar
- Espeland A, Albrektsen G, Larsen JL: Plain radiography of the lumbosacral spine. An audit of referrals from general practitioners. Acta Radiol. 1999, 40 (1): 52-59.PubMedGoogle Scholar
- Kerry S, Hilton S, Dundas D, Rink E, Oakeshott P: Radiography for low back pain: a randomised controlled trial and observational study in primary care. Br J Gen Pract. 2002, 52 (479): 469-474.PubMedPubMed CentralGoogle Scholar
- Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL: The implications of regional variations in Medicare spending. Part 2: health outcomes and satisfaction with care. Ann Intern Med. 2003, 138 (4): 288-298.View ArticlePubMedGoogle Scholar
- O'Donnell CA: Variation in GP referral rates: what can we learn from the literature?. Fam Pract. 2000, 17 (6): 462-471. 10.1093/fampra/17.6.462.View ArticlePubMedGoogle Scholar
- Leape LL, Park RE, Solomon DH, Chassin MR, Kosecoff J, Brook RH: Does inappropriate use explain small-area variations in the use of health care services?. JAMA. 1990, 263 (5): 669-672. 10.1001/jama.263.5.669.View ArticlePubMedGoogle Scholar
- Jimenez JR: Defensive radiology in Spain. Acad Radiol. 1996, 3: 118-119. 10.1016/S1076-6332(96)80505-8.View ArticleGoogle Scholar
- Royal College of Radiologists Working Party: A multicentre audit of hospital referral for radiological investigation in England and Wales. BMJ. 1991, 303 (6806): 809-812.View ArticleGoogle Scholar
- Light DW: The real ethics of rationing. BMJ. 1997, 315 (7100): 112-115.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/7/21/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.