- Study protocol
- Open Access
- Open Peer Review
Exercise on Prescription: trial protocol and evaluation of outcomes
© Sørensen et al; licensee BioMed Central Ltd. 2007
- Received: 17 January 2007
- Accepted: 02 March 2007
- Published: 02 March 2007
In many countries exercise prescriptions are used in an attempt to initiate a physically active lifestyle in sedentary populations. Previous studies have primarily evaluated low intensive exercise prescription interventions and found moderately positive effects on physical activity and aerobic fitness. In a highly intensive Danish exercise prescription scheme called 'Exercise on Prescription' (EoP) the general practitioners can prescribe EoP to sedentary patients with lifestyle diseases. The aim of this randomized trial is to assess the short- and long-term effects of the EoP scheme. Thus, the aim of this paper is to describe the randomized controlled trial designed for evaluating effectiveness of EoP, and to present results from validations of outcome measures.
EoP involves a 16-week supervised training intervention and five counselling sessions (health profiles). All patients referred to EoP were eligible for the trial and were offered participation during the baseline health profile. Comparisons between the EoP group and the control group were made at baseline, and after four and ten months. Physiological measures used were maximal oxygen uptake (VO2max), glycosylated haemoglobin (HbA1c), bodyweight, and BMI. Patient-reported measures used were physical activity, health-related quality of life, amount and intensity of exercise, compliance with national guidelines for physical activity, and physical fitness. The validation of the cycle ergometer test found a strong correlation between maximal work capacity and VO2max, and acceptable test-retest reliability at group level. Calibration of the HbA1c apparatus was stable over ten weeks with minimal use, and test-retest reliability was good. High agreement percents were found for test-retest reliability for the self-administered questionnaire.
The trial is designed to provide information about the effectiveness of the EoP scheme. The trial is part of a health technology assessment of EoP, which besides the effectiveness covers the patient perspective, the organization, and the health economy. All three methods validated were found useful for the EoP trial.
- Physical Activity
- Aerobic Fitness
- Exercise Prescription
- Nordic Walking
- Cycle Ergometer Test
Epidemiological studies have reported a reduced risk of lifestyle diseases and/or mortality with increased level of physical activity  and aerobic fitness . A physically active lifestyle is recommended both as part of treatment, prevention and rehabilitation with regard to a number of lifestyle diseases . Despite increasing awareness of the benefits of a physically active lifestyle, large parts of the population remain physically inactive, posing a serious threat to public health [4, 5].
In many countries exercise prescriptions are used in an attempt to initiate a physically active lifestyle in sedentary populations. However, a recent population-based analysis questions the impact of exercise prescriptions on increased physical activity at population level , and a population-based survey reports that general practitioners (GPs) give physical activity advice and exercise prescription to only 13 % and 3 %, respectively . Furthermore, a recent review concludes that exercise prescriptions only have a moderately positive effect on physical activity level and aerobic fitness . However, exercise prescriptions are still used extensively . Most exercise prescription studies have evaluated GP counselling in combination with low intensive interventions (e.g. possibility to see an exercise specialist , pedometers and exercise logs , community-based activities and telephone support , access to local physical activity facilities and leisure centres , telephone booster calls , and stage-matched written material ). Few studies have evaluated highly intensive exercise prescription interventions [8, 15, 16], and limited evidence supports the hypothesis that more intensive interventions will lead to larger improvements in physical fitness and physical activity [8, 17]. Furthermore, very few studies have used good measures of aerobic fitness and physical activity .
In an exercise prescription scheme called 'Exercise on Prescription' (EoP) used in a number of Danish counties GPs can refer sedentary patients with medically controlled lifestyle diseases or risk of developing lifestyle diseases to an EoP programme. EoP is a highly intensive exercise prescription scheme, which is implemented in primary care and includes group-based supervised training and motivational counselling.
The aim of this randomized trial is to assess the short- (four months) and long-term (ten months) effects of the highly intensive EoP scheme on physiological variables (maximal oxygen uptake (VO2max), glycosylated hemoglobin (HbA1c, in patients with impaired glucose tolerance), Body Mass Index (BMI), and bodyweight) and patient-reported variables (physical activity, health-related quality of life, amount and intensity of exercise, compliance with national guidelines for physical activity, and physical fitness). Thus, the aim of this paper is to describe the randomized controlled trial designed for evaluating effectiveness of EoP, and to present results from validations of outcome measures.
The EoP scheme was evaluated in a randomized trial conducted in 2005–2006 with two groups: EoP and control patients. The EoP scheme was launched one year prior to the evaluation and offered by the County of Ribe and the County of Vejle. Patients were referred to the EoP scheme by their GP. GPs act as gatekeepers in the Danish health care system .
The motivational counselling and the group-based supervised training intervention in EoP patients were carried out by a physiotherapist in 14 clinics geographically spread throughout the two counties.
Participants randomized to the control group were called in for a counselling session following randomization (Figure 1). Furthermore, the control group received similar health profiles as the EoP group, but only after four and ten months. After participating in the evaluation the control group was offered EoP.
Inclusion and exclusion criteria
General practitioners could refer patients with the following characteristics: 1) medically controlled lifestyle diseases, 2) motivated to change of lifestyle, 3) believed to be able to improve health from an increased physical activity level, and 4) willing to pay 750 DKr. (100 €) for the intervention. In addition to giving the referral the general practitioner informed the patient about the benefits of a physically active lifestyle in general.
Recruitment and allocation
Referred patients contacted an EoP clinic, and an appointment for the first health profile was scheduled (Figure 1). All patients referred to the EoP scheme were eligible for the trial and were offered participation in the randomized trial during the baseline health profile. Recruitment took place over 14 months in 2005 and 2006.
Informed consent was obtained, and volunteering patients were randomized to either the EoP group or the control group. Randomization was carried out by the first authors by means of concealed envelopes containing the name of the group. Group allocation was then reported by mail to the physiotherapist and the patient. Randomization was stratified according to diagnosis (cardiovascular diseases, metabolic syndrome, type II diabetes, and other diseases) in order to distribute diagnosis groups evenly in the two groups.
The EoP physiotherapists carried out both the physiological and patient-reported measures. Changes in physiological measures (VO2max, bodyweight, BMI, and HbA1c) and patient-reported measures (physical activity, health-related quality of life, amount and intensity of exercise, compliance with national guidelines for physical activity, and self-reported physical fitness) were assessed at the time of the health profiles (Figure 1).
Maximal oxygen uptake (VO 2 max) was measured using a maximal indirect cycle ergometer test modified from Pedersen & Nielsen , where VO2max was calculated from the maximal work capacity (Wmax). All tests were completed on a mechanically braked cycle ergometer (Ergomedic 874E or 828E, Monark, Varberg, Sweden). Rate of perceived exertion was evaluated using the 6–20 point Borg scale . Heart rate was measured using a telemetric system (Polar Vantage NV, Polar Electro KY, Kempele, Finland). Each workload consisted of three minutes of cycling at 60 rpm. A choice of two protocols was available: 1) an initial workload of 30 watts and increments of 30 watts until exhaustion (classic protocol), 2) an initial workload of 30 watts and increments of 60 watts until the subject rated perceived exertion ≥ 13 (somewhat hard). Thereafter increments of 30 watts were used until exhaustion (progressive protocol). The test was continued until the subject was unable to maintain a pedal frequency of 60 rpm despite verbal encouragement. Workload, maximal heart rate and total time were recorded, and Wmax and VO2max were calculated.
Glycosylated hemoglobin (HbA1c) was measured in capillary blood using the DCA 2000+ (Bayer Diagnostics Europe Ltd., Dublin, Ireland), and was only assessed in patients with reduced insulin sensitivity. HbA1c is an indicator of mean blood glucose level over the last 8–12 weeks and indirectly a measure of glycemic control . In a comparison between DCA 2000+ and the gold-standard technique in HbA1c assessment the correlation was above 0.9, and the test-retest reliability with the DCA 2000+ was above 95 % [24, 25].
Bodyweight was measured prior to the cycle ergometer test with patients wearing light clothes and no shoes using a commercial scale.
Body Mass Index (BMI) was calculated by dividing bodyweight with height squared.
All patient-reported measures were assessed by means of self-administered questionnaires distributed by the EoP physiotherapist during the health profiles. The questionnaire was self-explanatory, easy to fill in, not too extensive, and consisted of preset response categories.
Physical activity was assessed using a short questionnaire, which allowed for conversion to MET values .
Amount and intensity of exercise were assessed by asking 'how much exercise do you do during an average week?', and 'at what intensity do you most often exercise?'
Compliance with national guidelines for physical activity was assessed by asking 'how many days during an average week are you physically active more than 30 minutes?'
Self-reported physical fitness was assessed by asking 'how do you rate your present physical fitness?', 'how do you rate your present physical fitness compared to four months ago?', and 'how do you rate your present physical fitness compared to people your age?'
The outcome measures are surrogate measures for reduction in risk of morbidity and mortality.
All physiotherapists were trained in the different aspects of the evaluation prior to initiating the randomized trial. A manual described all parts of the evaluation in detail, and each clinic was visited several times before and during the evaluation.
Power calculations were performed for expected changes in VO2max. VO2max at baseline was estimated to 20 ml O2*(min*kg)-1, expected improvements were 15%, and expected SD was 3 ml O2*(min*kg)-1. Alpha was set at 0.05 and a power of 0.9 was chosen. Using these assumptions in the 'sampsi' command in Stata 9.0 the sample size was estimated to 22 in each group.
The changes from 0–4 and 0–10 months within the two groups separately will be assessed using paired t-test or Wilcoxon rank sum test depending on distribution. Furthermore, boxplots will be made for delta values for the changes from 0–4 and 0–10 months.
Comparisons between the EoP group and the control group will be made with changes from 0–4 and 0–10 months. The analysis will be performed as an intention-to-treat and carried out using a regression model incorporating delta values, controlling for baseline values, and adjusted for the effect of the different centres (physiotherapist clinics), further robust variance will be applied. For variables not fulfilling the normal distribution of residuals a Wilcoxon rank sum test will be used on delta values. These analyses will be supplemented with 'per protocol analyses'.
Drop-out analyses will be carried out for 0–4 months and 4–10 months. Completers and non-completers will then be compared for the different baseline variables using boxplots. The effect of drop-out will be compared with differences between the EoP group and the control group.
Statistical significance was set at p < 0.05.
Local ethics committee registration number VF 20040121. The Danish Data Protection Agency registration number 2004-41-4692. ClinicalTrials.gov registration number NCT00399997.
Validation studies were carried out for the cycle ergometer test, the HbA1c method, and the self-administered questionnaire. Detailed information about the validation studies can be found in the appendix.
Wmax cycle ergometer test validation
Validation was performed for both the calculation of VO2max from Wmax (equation study) and the comparison of the two different protocols (protocol study). The protocol study aimed at finding a less time-consuming protocol, and evaluating test-retest reliability.
DCA 2000+ glycosylated haemoglobin validation
Test-retest reliability for the DCA 2000+ apparatus was assessed in healthy subjects. Furthermore, a stability test of the calibration was performed by checking a DCA 2000+ apparatus with a known standard sample once a week over a period of ten weeks.
Good test-retest reliability and low LOA over a period of one week were found. Furthermore, calibration was stable for a period of ten weeks with minimal use.
Self-administered questionnaire validation
Test-retest reliability for the self-administered questionnaire was assessed for 16 EoP patients, who answered the questionnaire twice within 1–2 weeks. Agreement between the two completed questionnaires was assed using kappa statistics.
The test-retest reliability of the self-administered questionnaire proved good in terms of agreement percent despite low kappa values.
The EoP trial is designed to provide information about the effectiveness of the scheme. The trial is part of a health technology assessment of EoP, which besides the effectiveness covers the patient perspective, the organization, and the health economy .
The validation of the Wmax cycle ergometer test demonstrated a close relationship between Wmax and VO2max in a group of EoP patients (Figure 2) and acceptable test-retest reliability at group level (Figure 3, right). Furthermore, results from the classic and the progressive protocol were comparable at group level (Figure 3, left). However, at individual level the Wmax test was less reliable since LOA between the classic and the progressive test and between 1st and 2nd test were rather large. The validation of the DCA 2000+ apparatus for measuring HbA1c resulted in good test-retest reliability and low LOA in healthy subjects over a period of one week. Furthermore, calibration was stable for a period of ten weeks. The test-retest reliability of the self-administered questionnaire proved good in terms of agreement percent despite low kappa values. All three methods were found useful for the EoP trial.
Wmax cycle ergometer test validation
Cycle ergometer test validation subjects and results. Top: anthropometric data for the subjects. Bottom: results from the maximal test. Data are presented as mean ± SD and range.
Women (N = 10)
Men (N = 10)
All (N = 20)
Women (N = 16)
Men (N = 4)
All (N = 20)
52 ± 12
52 ± 12
52 ± 11
57 ± 10
53 ± 9
56 ± 10
86.9 ± 16.6
99.0 ± 17.0
93.0 ± 17.5
81.9 ± 14.8
97.4 ± 9.3
85.1 ± 14.9
164 ± 8
178 ± 6
171 ± 10
166 ± 7
178 ± 4
168 ± 8
31.9 ± 4.0
31.1 ± 4.7
31.5 ± 4.3
29.8 ± 4.9
30.7 ± 2.2
30.0 ± 4.3
Heart rate (beats*min-1)
160 ± 15
164 ± 13
162 ± 14
160 ± 16
166 ± 17
160 ± 14
Rate of perceived exertion
18.8 ± 1.2
18.6 ± 1.1
18.7 ± 1.1
18.4 ± 1.1
18.5 ± 1.3
18.5 ± 1.2
145.3 ± 36.6
192.7 ± 57.2
169.0 ± 52.7
142.0 ± 36.0
179.3 ± 22.8
149.9 ± 34.6
VO2max (ml O2*min-1)
2,102 ± 455
2,896 ± 827
2,499 ± 767
Respiratory exchange ratio (VCO2max/VO2max)
1.10 ± 0.04
1.06 ± 0.05
1.08 ± 0.05
All tests were completed on a mechanically braked cycle ergometer (Ergomedic 874E or 828E, Monark, Varberg, Sweden). In the equation study pulmonary gas exchange was measured breath-by-breath and averaged over the last 30 seconds to determine VO2max (Oxycon Pro, Erich Jaeger GmbH, Hoechberg, Germany). Blood samples were collected from a fingertip and analyzed for blood lactate (YSI 1500 Sport Lactate Analyzer, Yellow Springs Instruments, OH, USA). Rate of perceived exertion was evaluated using the 6–20 point Borg scale . Heart rate was measured using a telemetric system (Polar Vantage NV, Polar Electro KY, Kempele, Finland).
Subjects completed a familiarization test on a separate day prior to the studies. The equation study used the classic protocol. The protocol study compared the classic and the progressive protocols in the protocol study. The classic and progressive protocols were performed in random order and were separated by 3–14 days.
In the equation study linear regression was performed on the VO2max-Wmax relationship, and a strong correlation was found (VO2max = 13.895 ml O2*min-1 * Wmax + 151 ml O2*min-1, R2 = 0.911, p < 0.0001) (Figure 2). The prediction interval was 452 ml O2*min-1, which indicated a large individual variability. Some 95% of observations in the population are expected to fall within the prediction interval. The SD used for the prediction interval was the SD of the difference between measured and estimated VO2max. In the protocol study the comparison between the classic and progressive test indicated that the protocols result in similar Wmax values at group level (Figure 3, left). Comparison of the 1st and 2nd test found a non-significant increase of 3.9 watt (Figure 3, right). However, the large limits of agreement (LOA) in both comparisons indicated large individual variability . For this reason the Wmax test should primarily be used for comparisons at group level. The coefficient of variation, calculated using the method of Vasikaran , was 6.95% in both comparisons.
DCA 2000+ glycosylated haemoglobin validation
HbA1c was assessed three times over a period of one week in nine subjects (four women and five men). Blood samples were collected from both capillary and vein. Mean difference of HbA1c between venous and capillary blood samples was 0.004% HbA1c, and LOA was 0.39. Using one-way ANOVA resulted in with-in subject SD for the three time points of 0.13 (LOA 0.26) and 0.16 (LOA 0.32) for venous and capillary blood, respectively. Only small variations in the measurement of the standard sample were observed over a period of ten weeks, and the range of deviation from the standard samples was 0.1 to 0.4% HbA1c.
Self-administered questionnaire validation
Agreement was for SF-12 67–97% (mean 90%), for EQ-5D 69–100% (mean 89%) and for physical activity level 87–99% (mean 93%). However, low kappa values were found for several questions in SF-12 0.19–0.88 (mean 0.49), EQ-5D 0.25–1.00 (mean 0.66), and physical activity 0.19–0.91 (mean 0.62), due to an unbalanced marginal distribution caused by few or no observations in some response categories and a small number of participants in this part of the study. The paradox of high agreement percent and low kappa value has been described by Feinstein and Cicchetti .
We would like to thank Assistant Professor Thomas Skovgaard, PhD, Unit for Health Promotion Research, University of Southern Denmark; Thomas Bredahl, Centre of Applied and Clinical Exercise Sciences, Institute of Sport Science and Clinical Biomechanics, University of Southern Denmark; Rolf Jakobsen, the County of Ribe; and Stephan Siig Hansen, the County of Vejle. Furthermore, we would like thank Associate Professor Lars Korsholm, PhD, Department of Statistics, University of Southern Denmark, for statistical assistance.
Local ethics committee registration number VF 20040121. The Danish Data Protection Agency registration number 2004-41-4692.
The study received financial support from the Danish Medical Research Council, The Ministry of the Interior and Health, The National Board of Health, The County of Ribe, and The County of Vejle. Representatives from the County of Ribe and the County of Vejle took part in the designing of the study.
- Andersen LB, Schnohr P, Schroll M, Hein HO: All-cause mortality associated with physical activity during leisure time, work, sports, and cycling to work. Arch Intern Med. 2000, 160: 1621-1628. 10.1001/archinte.160.11.1621.View ArticlePubMedGoogle Scholar
- Blair SN, Kampert JB, Kohl HW, Barlow CE, Macera CA, Paffenbarger RS, Gibbons LW: Influences of cardiorespiratory fitness and other precursors on cardiovascular disease and all-cause mortality in men and women. JAMA. 1996, 276: 205-210. 10.1001/jama.276.3.205.View ArticlePubMedGoogle Scholar
- Pedersen BK, Saltin B: Evidence for prescribing exercise as therapy in chronic disease. Scand J Med Sci Sports. 2006, 16 Suppl 1: 3-63. 10.1111/j.1600-0838.2006.00520.x.View ArticlePubMedGoogle Scholar
- Consultation JWHOFAOE: 2003, Geneva, Switzerland, WHO, 916: Diet, nutrition and the prevention of chronic diseases, WHO Technical Report Series.Google Scholar
- WHO: Global strategy on diet, physical activity and health. 2004, France, WHOGoogle Scholar
- Harrison RA, McNair F, Dugdill L: Access to exercise referral schemes - a population based analysis. J Public Health (Oxf). 2005, 27: 326-330. 10.1093/pubmed/fdi048.View ArticleGoogle Scholar
- Croteau K, Schofield G, McLean G: Physical activity advice in the primary care setting: results of a population study in New Zealand. Aust N Z J Public Health. 2006, 30: 262-267.View ArticlePubMedGoogle Scholar
- Sorensen JB, Skovgaard T, Puggaard L: Exercise on prescription in general practice: A systematic review. Scand J Prim Health Care. 2006, 24: 69-74. 10.1080/02813430600700027.View ArticlePubMedGoogle Scholar
- Dugdill L, Graham RC, McNair F: Exercise referral: the public health panacea for physical activity promotion? A critical perspective of exercise referral schemes; their development and evaluation. Ergonomics. 2005, 48: 1390-1410. 10.1080/00140130500101544.View ArticlePubMedGoogle Scholar
- Aittasalo M, Miilunpalo S, Kukkonen-Harjula K, Pasanen M: A randomized intervention of physical activity promotion and patient self-monitoring in primary health care. Prev Med. 2006, 42: 40-46. 10.1016/j.ypmed.2005.10.003.View ArticlePubMedGoogle Scholar
- Elley CR, Kerse N, Arroll B, Robinson E: Effectiveness of counselling patients on physical activity in general practice: cluster randomised controlled trial. BMJ. 2003, 326: 793-798. 10.1136/bmj.326.7393.793.View ArticlePubMedPubMed CentralGoogle Scholar
- Harrison RA, Roberts C, Elton PJ: Does primary care referral to an exercise programme increase physical activity one year later? A randomized controlled trial. J Public Health (Oxf). 2005, 27: 25-32. 10.1093/pubmed/fdh197.View ArticleGoogle Scholar
- Van Sluijs EM, Van Poppel MN, Twisk JW, Chin APMJ, Calfas KJ, Van MW: Effect of a tailored physical activity intervention delivered in general practice settings: results of a randomized controlled trial. Am J Public Health. 2005, 95: 1825-1831. 10.2105/AJPH.2004.044537.View ArticlePubMedPubMed CentralGoogle Scholar
- Smith BJ, Bauman AE, Bull FC, Booth ML, Harris MF: Promoting physical activity in general practice: a controlled trial of written advice and information materials. Br J Sports Med. 2000, 34: 262-267. 10.1136/bjsm.34.4.262.View ArticlePubMedPubMed CentralGoogle Scholar
- Pinto BM, Goldstein MG, Ashba J, Sciamanna CN, Jette A: Randomized controlled trial of physical activity counseling for older primary care patients. Am J Prev Med. 2005, 29: 247-255. 10.1016/j.amepre.2005.06.016.View ArticlePubMedGoogle Scholar
- Behavioral counseling in primary care to promote physical activity: recommendation and rationale. Ann Intern Med. 2002, 137: 205-207.Google Scholar
- Jacobson DM, Strohecker L, Compton MT, Katz DL: Physical activity counseling in the adult primary care setting: position statement of the American College of Preventive Medicine. Am J Prev Med. 2005, 29: 158-162. 10.1016/j.amepre.2005.04.009.View ArticlePubMedGoogle Scholar
- Hillsdon M, Foster C, Thorogood M: Interventions for promoting physical activity. Cochrane Database Syst Rev. 2005, CD003180.Google Scholar
- Pedersen KM, Christiansen T, Bech M: The Danish health care system: evolution--not revolution--in a decentralized system. Health Econ. 2005, 14: S41-S57. 10.1002/hec.1028.View ArticlePubMedGoogle Scholar
- Stand ACSMP: American College of Sports Medicine Position Stand. The recommended quantity and quality of exercise for developing and maintaining cardiorespiratory and muscular fitness, and flexibility in healthy adults. Med Sci Sports Exerc. 1998, 30: 975-991. 10.1097/00005768-199806000-00032.View ArticleGoogle Scholar
- Pedersen PK, Nielsen JR: Absolute or relative work load in exercise testing--significance of individual differences in working capacity. Scand J Clin Lab Invest. 1984, 44: 635-642.View ArticlePubMedGoogle Scholar
- Borg G: Perceived exertion as an indicator of somatic stress. Scand J Rehabil Med. 1970, 2: 92-98.PubMedGoogle Scholar
- Boulé NG, Haddad E, Kenny GP, Wells GA, Sigal RJ: Effects of exercise on glycemic control and body mass in type 2 diabetes mellitus. JAMA. 2001, 286: 1218-1227. 10.1001/jama.286.10.1218.View ArticlePubMedGoogle Scholar
- Diem P, Walchli M, Mullis PE, Marti U: Agreement between HbA1c measured by DCA 2000 and by HPLC: effects of fetal hemoglobin concentrations. Arch Med Res. 2004, 35: 145-149. 10.1016/j.arcmed.2003.10.003.View ArticlePubMedGoogle Scholar
- Arsie MP, Marchioro L, Lapolla A, Giacchetto GF, Bordin MR, Rizzotti P, Fedele D: Evaluation of diagnostic reliability of DCA 2000 for rapid and simple monitoring of HbA1c. Acta Diabetol. 2000, 37: 1-7. 10.1007/s005920070028.View ArticlePubMedGoogle Scholar
- Norman A, Bellocco R, Bergstrom A, Wolk A: Validity and reproducibility of self-reported total physical activity--differences by relative weight. Int J Obes Relat Metab Disord. 2001, 25: 682-688. 10.1038/sj.ijo.0801597.View ArticlePubMedGoogle Scholar
- Ware JE, Kosinski MA, Turner-Bowker DM, Gandek B: How to Score Version 2 of the SF-12 Health Survey (With a Supplement Documenting Version 1). 2005, Lincoln, Rhode Island, QualityMetric IncorporatedGoogle Scholar
- Brooks R: EuroQol: the current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.View ArticlePubMedGoogle Scholar
- Jorgensen T, Hvenegaard A, Kristensen FB: Health technology assessment in Denmark. Int J Technol Assess Health Care. 2000, 16: 347-381. 10.1017/S0266462300101047.View ArticlePubMedGoogle Scholar
- Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.View ArticlePubMedGoogle Scholar
- Vasikaran SD, McCloskey EV, Kahn S, Kanis JA: Intra-individual variation in fasting urinary calcium- and hydroxyproline-creatinine ratios measured in metabolic bone clinic patients as both outpatients and inpatients. Ann Clin Biochem. 1994, 31 ( Pt 3): 272-276.View ArticleGoogle Scholar
- Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/7/36/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.