Skip to main content
  • Study protocol
  • Open access
  • Published:

Study protocol of an equivalence randomized controlled trial to evaluate the effectiveness of three different approaches to collecting Patient Reported Outcome Measures (PROMs) data using the Prostate Cancer Outcomes Registry-Victoria (PCOR-VIC)



Patient-reported outcome measures (PROMs) are used by clinical quality registries to assess patients’ perspectives of care outcomes and quality of life. PROMs can be assessed through a self-administered survey or by a third party. Use of mixed mode approaches where PROMs are completed using a single or combination of administration method is emerging. The aim of this study is to identify the most cost-effective efficient approach to collecting PROMs among three modes (telephone, postal service/mail and email) in a population-based clinical quality registry monitoring survivorship after a diagnosis of prostate cancer. This is important to assist the registry in achieving representative PROMs capture using the most cost-effective technique and in developing cost projections for national scale-up.


This study will adopt an equivalence randomised controlled design. Participants are men diagnosed with and/or treated for prostate cancer (PCa) participating in PCOR-VIC and meet the criteria for 12-month follow-up. Participants will be individually randomized to three independent groups: telephone, mail/postal, or email to complete the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) survey. It is estimated each group will have 229 respondents. We will compare the proportion of completed surveys across the three groups.

The economic evaluation will be undertaken from the perspective of the data collection centre and consider all operating costs (personnel, supplies, training, operation and maintenance). Cost data will be captured using an Activity Based Costs method. To estimate the most cost-effective approach, we will calculate incremental cost-effectiveness ratios. A cost projection model will be developed based on most cost-effective approach for nationwide scale-up of the PROMs tool for follow-up of PCa patients in Australia.


This study will identify the most cost-effective approach for collecting PROMs from men with PCa, and enable estimation of costs for national implementation of the PCa PROMs survey. The findings will be of interest to other registries embarking on PROMs data collection.

Trial registration

ACTRN12615001369516 (Registered on December 16, 2015)

Peer Review reports


Patient reported outcome measures (PROMs) are designed to measure patients’ views of their symptoms, own functional status, treatment satisfaction and health related quality of life in relation to specific disease or conditions [14]. PROMs are an important measure of patients’ perspective of care outcomes as they provide insight into the impact of a disease and its treatment on daily lives. PROMs can assist clinicians to work with patients to achieve a level of care that meets their needs; this has been demonstrated to improve patient-provider communication [5].

PROMs may be self-administered or administered by another person (third-party). Instruments used to collect PROMs should be validated for the mode with which they are being administered. Self-administration may include surveys that patients complete on paper or electronically (e.g. via links provided in an email address to an online form or through Applications (apps) that patients can download. Tools administered by another person may include those completed on paper or electronically with assistance or those administered over the telephone [6, 7]. With the increasing number of Internet users, greater opportunities exist for collecting data, through mechanisms such as email and web-based surveys [8, 9]. An emerging trend in health-related survey research is the use of a mixed-mode approach. In the mixed-mode method, individuals may respond using a single or combination of different modes, such as only telephone or mail followed by telephone [10]. Using a mixed-mode approach compensates for the weaknesses of each individual mode at affordable cost [11]. Survey mode, length and content of the survey and incentives will impact the response rates and the cost of data collection [12].

The amount of clinical data being collected is growing exponentially; largely due to computer-based information systems [13]. In Australia, the number of known registries collecting clinical data has risen from 28 in 2006-07 to 37 in 2012 [14]. Clinical quality registries have received increasing attention as a means of improving quality and reducing the cost of health and medical care, through identifying variations in clinical practice and care, and assessing the uptake of effective treatment [15, 16]. A number of clinical quality registries collect PROMs and provide reports on outcomes to hospitals. Examples can be found in trauma [17], joint replacement [18] and renal disease [19]. PROMs are being developed by the American Society of Clinical Oncology to benchmark hospitals in relation to symptoms and functional status following cancer treatment [20].

For any individual research study, the mode of data collection is influenced by time, available resources and the population being targeted [21]. A number of studies have compared response rates using different modes of data collection [22]. A meta-analysis published in 2009 found that email surveys have lower response rates compared with mail surveys (20% vs 53% respectively) suggesting that, despite rapid growth of information technology, mail surveys appear to be superior to email in collecting survey data [22]. High response rates have been obtained when follow up attempts are intense and personalised. For example Steineck et all reported very high response rates of 89 to 99% across multiple time periods by following a regimen which included an introduction letter and a telephone call to establish contact prior to a survey being posted and a “thank you and reminder” card following return of the survey [23, 24]. It is unclear whether such a labour-intensive approach is sustainable at a population level.

Response rates have been found to vary among study populations. Postal surveys with three reminders have shown demonstrably better response rates among general practitioners compared with a telephone survey [25]. A randomised control trial (RCT) of junior medical staff and faculty members comparing electronic and postal surveys found that response rates were similar, but the average response time for electronic surveys was shorter for the residents’ group compared with the faculty group (3.8 days vs 8.4 days, p < 0.001) [26].

A recent meta-analysis by Rutherford et al. [27] investigated whether the mode of PROMs administration introduced bias into the patient reported outcome results. Findings suggested that there was no bias associated with whether PROMs were collected electronically (computer including web, touch screen, hand-held device, video conference, computer assisted telephone interview), via paper self-completion (hard copy) or via assisted completion in clinics or home. The authors of the study recommended further research using experimental designs to measure the mediators of mode effects on data quality, measurement equivalence, reliability of assessment for individuals and the impact of setting and combination of data collection method over time [27].

A cost-effectiveness study by Sinclair et al. (2012) found that postal survey costs were lower compared to both internet and telephone. The cost of a completed response using a personalised postal survey (24.75 Australian Dollars) was slightly higher than the generic postal survey, a generic internet survey and a personalised internet survey cost was almost double of a personalised postal survey and a telephone survey cost was highest among all methods [28]. Another study conducted by the Australian national stroke registry, found that telephone follow up for patient with acute stroke or transient ischemic attack was more expensive but more effective in terms of completion rates than follow-up by postal mail [16].

The Victorian Prostate Cancer Registry (PCOR-VIC) was established in 2009 to monitor treatment and outcomes of men diagnosed with prostate cancer in Victoria. PROMs are collected to assess the impact of prostate cancer diagnosis/treatment on urinary, bowel, hormonal, and sexual function and bother using the EPIC-26 survey [29]. The EPIC-26 survey has been validated for telephone and self-administered survey (paper or online) and is currently only administered by telephone [30]. The response rate has varied over time as modifications have been made to the registry and is currently at 85%. Alternative methods of PROMs administration have not been systematically assessed for their cost-effectiveness and feasibility. Although previous studies demonstrated lower response rates and in some cases increased costs of surveys delivered electronically, these were conducted several years ago and on a different population. As the PCOR-VIC is now contributing to a newly developed Prostate Cancer Registry-Australia and New Zealand, [31] the aim of this project was to assess the most cost-effective approach for collecting PROMs in a prostate cancer population.

The current study protocol describes the design of an equivalence RCT to assess the cost-effectiveness of three different methods of PROMs data collection using the EPIC-26 survey for patients diagnosed with prostate cancer.

The primary objective of the trial is to compare the completeness of survey data obtained using the three different data collection approaches for reporting on PROMs.

The secondary objectives are to:

  1. a.

    Estimate recurrent costs of data collection using telephone, postal services/mail and electronic mail (email) for PROMs data in PCOR-VIC.

  2. b.

    Compare the cost-effectiveness of the three different methods of data collection.

  3. c.

    Develop a cost projection model to estimate the cost for nation-wide scale-up of administering the PROMs data collection tool in the most efficient setting for follow up of prostate cancer patients in Australia.



Men who are diagnosed with prostate cancer in Victoria, contributing to the PCOR-VIC and who are interviewed by researchers to collect PROMS, will be invited to participate in this study. Since its establishment in 2009 the registry has expanded to 33 hospitals across the state, representing approximately 75% of the Victorian population [32]. Men are eligible for inclusion on the register if they have had a histologically confirmed diagnosis of prostate cancer that is notified to the Victorian Cancer Registry by the hospital.

Trial design

The study design proposed for this evaluation is an equivalence RCT design. Participants will be individually randomized to one of three independent groups receiving the PROMs instrument by email, post or by telephone. Due to the nature of the intervention, it is not possible to blind the researchers or study participants.

To collect costing data we will use an Activity Based Costing (ABC) method [33] and structured questionnaires to estimate the cost of the operational activities of the three different methods of follow up. The ABC method is useful for understanding key activities of any programs and interventions and allows identification of (i) implementation levels and composition of costs; (ii) variations in how an intervention is implemented over time and associated cost implications; and (iii) resulting costs of increasing coverage of cost-effective data collection methods. This method is flexible, so its resulting estimates can be easily understood and adapted to measure the cost of data collection of the three different methods. Costs that will be considered include personnel cost, cost of supplies (e.g., envelopes, printing etc.), cost of training of data collectors and cost of operation and maintenance (e.g., telephone bill, internet bill, rent etc.) for each of the data collection methods.

Recruitment of patients

Recruitment of patients to the PCOR-VIC has been previously described [34]. In summary, patients diagnosed in recruiting hospitals and notified by the hospital to the registry are sent details of the registry in an explanatory statement by mail. In the explanatory statement details on what data will be collected from the patient’s medical record and directly from the patient and how a man can opt off the registry if he chooses not to participate are included. The explanatory statement also contains the contact details of both the hospital where the patient was diagnosed and the university conducting the research and hosting the registry. Clinical data are collected on men who do not opt out. A waiver of consent enables clinical details to be collected from men who have died after diagnosis.

Eligible men are contacted by centrally-located university call-centre follow up staff to confirm that clinical data are accurate and up-to-date. For data collection contact is made any time within a window period of 21 days on either side of the anniversary date for data collection (henceforth recorded as the “Anniversary Date”). This is 12 months from the date of the positive biopsy for patients who do not proceed to active treatment or only receive androgen deprivation therapy; or 12 months from the date on which final initial treatment, or course of treatment finished. This is also the date for surgery and low-dose rate (seed) brachytherapy procedure. For radiotherapy and chemotherapy this is the date that the last dose of therapy was provided as well.

Inclusion criteria

Men will be included in this study if they are eligible and have been included on the PCOR-VIC, are aged >18 years and answer the telephone when contacted by data collectors in the 21 days leading up to and including their Anniversary Date.

Exclusion criteria

Men will be ineligible for inclusion in the RCT if they opt off the registry, have died in the period between being recruited to the registry and telephoned, do not speak English, are identified as being hearing or mentally impaired when contacted by data collectors to administer the PROMs, have been diagnosed by Transurethral Resection of the Prostate (TURP) and their treating doctor has requested that we do not contact them for follow up, or if they answer the telephone after their Anniversary Date.

Outcome of interest

Primary outcome

The primary outcome of interest will be effective successful follow up. Effective successful follow up is defined as providing a response to each of the 26 questions in the survey. Provision exists for patients to record “decline to answer’ on the electronic form and they are advised at the beginning of the phone call that they may chose not to answer if they wish. Responses will still be considered completed if the patient declines to answer.

Secondary outcomes

Secondary outcome measures include time to complete an effective follow-up, and the number of occasions where answering a question was declined for each mode of survey administration.

Sample size

Sample size calculations were based on an equivalence study design [35] and the primary outcome measure (completeness of survey responses). Given the current follow up response rates from the PCOR-VIC we estimate that we will achieve a response rate of 90% [32] when PROMs are administered by the telephone follow-up method. The study was designed to evaluate whether the completeness of survey responses in the ‘mail/postal service group’ or ‘email group’ was similar to the ‘telephone’ group. Assuming that the equivalence margin is 10%, we will require 190 respondents per group. We have made an assumption that the 83% of who have internet access will also have an email account [36]. The sample size was adjusted accordingly so the final number of respondents required in each group is 229 giving a total number required n = 687 (Table 1). Our sample size has been calculated to provide a level of significance at 5% with 80% power (2-sided test). The sample size calculation was performed in Stata V13.0 [37].

Table 1 Sample size calculation

Randomisation process

Figure 1 illustrates the different steps for following up patients on the PCOR-VIC registry to complete the PROM (EPIC-26 survey). The first step after data collectors’ telephone to men is to confirm treatment and GP details and obtain the most recent PSA result. If the patient is contacted within the window from 21 days before the “Anniversary Date”, then they will be eligible for randomization. Randomization will be undertaken using random permuted blocks of sizes 3 and 6 [38]. The investigator will have already generated the random blocks and provide those to the data collectors in sealed envelopes. Once the data collector has confirmed the patient’s PSA result, GP details and eligibility for 12-month follow-up then s/he will proceed with selecting a random number from the sealed envelope to assign the method for collection of data by EPIC-26 survey. If a patient has been assigned to the email method but, when the data collector asks for an email address and the patient replies that he does not have one, the data collector will select the next and subsequent envelopes until either the telephone method (Intervention A) or mail/postal methods (Intervention B) is assigned.

Fig. 1
figure 1

Flow chart showing 3 different follow-up methods

Description of intervention(s)/exposure

An attempt will be made to contact all men who have not opted off the registry and meet the eligibility criteria. The details and procedure followed by data collectors for administering the EPIC-26 survey following randomisation to one of the three approaches is described below and presented in Fig. 1 Flow Chart showing 3 different follow up methods.

Intervention A: PROMs data collection by follow-up data collectors over the telephone

  1. 1.

    An attempt to contact patients via phone will be made up until 21 days post diagnosis/treatment. Each day a data collector will make one attempt to contact the patient.

  2. 2.

    Patients responding will have PROMS entered directly to the PCOR-VIC web system.

  3. 3.

    Patients will be considered lost to follow up if they do not respond after 21 days from 12 month “Anniversary Date”.

Intervention B: Data collection by follow up data collectors by mail (postal service)

  1. 1.

    The EPIC-26 survey will be mailed to patients if they are contacted any time from 21 days before, up to and including the “Anniversary Date”. The survey will be accompanied with a personalised, signed letter with instructions and a postage-paid, self-addressed envelope.

  2. 2.

    If the survey is not returned by 14 days post the Anniversary Date, patients will be telephoned as per Intervention A. Data collector will make one attempt each day i.e 14 attempts in total.

  3. 3.

    Patients will be considered lost to follow up if they do not respond after 21 days from 12 month “Anniversary Date”.

Intervention C: Data collection by E-mail link to online survey

  1. 1.

    If email is not available then the participants will be randomly assigned to either telephone (intervention A) or mail (Intervention B).

  2. 2.

    A Uniform Resource Locator (URL) which is the address of a web page link to the EPIC-26 survey will be emailed to participants if they are contacted any time from 21 days before, up to and including the “Anniversary Date”.

  3. 3.

    If participants do not complete the online survey by 14 days post the Anniversary Date, patients will be telephoned as per Intervention A. Data collector will make one attempt each day i.e 14 attempts in total. Patients will be considered lost to follow-up if they do not respond after 21 days from 12 month “Anniversary Date”.

Duration of the project

We anticipate that the recruitment process will commence on the 1stof February 2016. Data collection will take place between February 2016 and November 2016. Based on current number of patients that become eligible for follow-up each month, we anticipated that it will require approximately 8-9 months to reach our total sample size of 687. An additional 2 months will be required for entering, analysing costing data and for report writing and developing draft manuscripts.

Data collection, quality and monitoring methods

We will employ quantitative methods of data collection through structured questionnaires. For costing, the ABC [33] method will be adopted. Table 2 describes the data collection methods that will be used to obtain data for each specific objectives. Data will be collected by trained data collectors and supervised by the project manager and study investigators. Data collectors are from an academic institution (Monash University) and are independent of the hospitals. To ensure data quality, validation tools will be built in the web-based system. Routine monitoring meeting will also be held to ensure any problems encountered during data collection and randomization process.

Table 2 Description of the specific objectives and methods

Data analysis plan

Primary and secondary outcomes

For the primary outcome measure (completeness of surveys), we will estimate individual proportions with 95% CI for each arm of the trial. We will then calculate the pooled sample proportions for each pair and the standard error of the difference. Using these measures, we will calculate the Z score test statistics. The p value will be reported for the difference and P < 0.05 will be considered as statistically significant.

For the secondary outcome measures, we will carry out independent sample t-tests to detect the difference.

Analysis will be conducted by intention to treat (ITT) [39] as well as per protocol method [40]. The ITT method will allow us to evaluate the effect of each intervention in a real life situation (i.e. when subjects are randomized to the ‘email group’ but end up in the ‘telephone’ or ‘mail’ methods instead). The per-protocol method will allow us to study the direct effect of each option.

Economic analysis

The economic evaluation will consider the costs of personnel resources, supplies, and operating costs as described below. The analysis will not consider development of the PCOR-VIC database, as we consider that this cost will be identical regardless of the data collection modality. However, the additional costs associated with developing the automated email system within the register will be captured.

  1. a.

    Valuing personnel resources

    The value of the research staff contacting patients will be measured in terms of salaries, allowances and benefits received during the study period for their time. At Monash University, all personnel maintain a time sheet for their usual activities. We shall calculate time taken for the data collection processes from time sheets for the period of data collection (February 2016-November 2016). As the level of competence required to undertake all tasks are comparable, we will cost the time using a consistent salary across all three groups.

  2. b.

    Valuing supplies and other recurrent costs

    The values of line items outlined in Table 3 will be included as variable inputs and valued at the price at which they were obtained. Items obtained free of cost will be valued at market price – that is, the price paid if purchased from the local or international market. If price from the international market is used then that price will be changed in Australian dollars using the purchasing power parity (PPP) of Australian dollar with USD in 2015 [41]. The actual expenditure for rent, utilities and supervision during the year will be taken into account [41]. These costs data will be collected from the managers of the data collection facilities using a structured questionnaire.

    Table 3 Cost data collection of 3 different methods
  3. c.

    Methodology of time allocation of providers

    Data collectors will maintain a spreadsheet to record the time spent for each data collection method. The time will be categorised into direct data collection and non-service professional activities which includes preparatory activities, maintaining and management of records and information, and obtaining supplies.

  4. d.

    Calculating Total and Average Costs:

    We will sum personnel costs, cost of supplies, training costs and costs of operation and maintenance to provide a total cost for each of the follow up methods as well as average cost for each constituent items.

  5. e.

    Estimating cost effectiveness

    To estimate the most cost-effective approach, incremental cost effectiveness ratios (ICERs) will be estimated. This involves comparing the incremental/additional cost of one approach with the additional outcome achieved by using that approach. Outcome will be measured as completed surveys. The most cost effective approach will be the method which achieves the greatest percentage of complete surveys at the least cost [42]. Scenario analysis will be undertaken to test some of the assumptions in estimating the cost of each approach.

Cost projection modelling

A cost projection model will be developed based on the most cost-effective approach for collecting completed PROMs surveys. The model will use epidemiological data (Australian prostate cancer incidence data) and the estimated follow-up cost. A sensitivity analysis will be conducted using different follow up rates and cost assumptions.

Quality assurance

This study will be conducted in accordance with the National Health and Medical Research Council (NHMRC) Code of Responsible Conduct of Research.

Dissemination of results and publication policy

Results of this study will be disseminated to the scientific community through conferences, seminars presentations and publications in peer-reviewed journals. We will present the findings at the Registry Special Interest Group at Monash University to ensure that the lessons learned in the PCOR-VIC registry are made available to other registry custodians.

Data storage, access and security arrangements

The PCOR-VIC data are housed on a secure server at Monash University. Security is maintained using encryption of data, a managed and audited protocol for access, training and accreditation of personnel, role-based access and authentication of data. The database storing PROMs and costing data will be password protected and stored on a networked server that is backed up on a daily basis at Monash University.

Potential risks

As the participants are diagnosed with prostate cancer, they may experience distress when discussing the disease with follow up staff over telephone. There will be no pressure on the participants to divulge any information if they do not feel comfortable to do so. An offer will be made to terminate the interview if the participants exhibit any signs of distress. The interview will only be continued if the participants want to do so. As there will be no physical examination, biomedical tests (invasive/non-invasive) or use of hazardous material, this project is deemed to be a low-risk research activity.


Through this economic analysis we will determine the most cost-effective means of capturing PROMs and completing follow up of prostate cancer patients through the PCOR-VIC using the EPIC-26 survey. Our primary aim therefore is to identify the value of different PROMS collection methods. Value is defined as outcomes relative to costs and encompasses efficiency [43]. The outcome we will be evaluating is response rates and representativeness of the various tools in assessing the quality of life. With knowledge of the cost of each completed survey, we will decide which approach to use as we expand data collection to obtain national coverage. Our primary objective is to assess the response rate across each data collection approach. Surveys will only be considered as completed if all relevant questions have been answered.

This will provide guidance to other registries undertaking follow up surveys of patients and it will also allow us to estimate the cost for collecting PROMs data within the Prostate Cancer Outcome Registry- Australia. Moreover we will be able to understand the quality of PROMs data collected by the three different methods. It may be that one method produces significantly higher rate of missing data or questions which patients decline to answer. We have to weigh the cost of data collection against completeness of surveys to determine the method which provides the greatest value at the end of the study. This decision will be made by the project steering committee and the funder.


The aim of this study is to provide evidence on which method of PROMs follow up data collection is more cost-effective. Findings of this study will also help us in understanding the cost for national implementation of the prostate cancer quality of life questionnaire in Australia.



Activity Based Costing


Expanded Prostate Cancer Index Composite


General Practitioner


Incremental Cost Effectiveness Ratios


Intention to Treat


Monash Graduate Scholarship


Monash International Postgraduate Research Fellowship


National Health and Medical Research Council


Prostate Cancer


Prostate Cancer Outcome Registry- Victoria


Purchasing Power Parity


Patient Reported Outcome Measures


Prostate Specific Antigen


Randomized Controlled Trial


Transurethral Resection of The Prostate


Uniform Resource Locator


  1. Black N. Patient reported outcome measures could help transform healthcare. BMJ (Clinical research ed). 2013;346:f167.

    Google Scholar 

  2. Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr AJ. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186.

    Article  PubMed  Google Scholar 

  3. Patrick DL, Burke LB, Powers JH, Scott JA, Rock EP, Dawisha S, et al. Patient‐Reported Outcomes to Support Medical Product Labeling Claims: FDA Perspective. Value Health. 2007;10(s2):S125–37.

    Article  PubMed  Google Scholar 

  4. Coons SJ, Gwaltney CJ, Hays RD, Lundy JJ, Sloan JA, Revicki DA, et al. Recommendations on Evidence Needed to Support Measurement Equivalence between Electronic and Paper‐Based Patient‐Reported Outcome (PRO) Measures: ISPOR ePRO Good Research Practices Task Force Report. Value Health. 2009;12(4):419–29.

    Article  PubMed  Google Scholar 

  5. Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res. 2013;13(1):1–24.

    Article  Google Scholar 

  6. Fan W, Yan Z. Factors affecting response rates of the web survey: A systematic review. Comput Human Behav. 2010;26:132–9.

    Article  Google Scholar 

  7. O’Toole BI, Battistutta D, Long A, Crouch K. A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. Am J Epidemiol. 1986;124(2):317–28.

    PubMed  Google Scholar 

  8. Kwak N, Radler B. A comparison between mail and web surveys: Response pattern, respondent profile, and data quality. J Off Stat-Stockh. 2002;18(2):257–74.

    Google Scholar 

  9. Cobanoglu C, Warde B, Moreo PJ. A comparison of mail, fax and web-based survey methods. Int J Mark Res. 2001;43(4):441–52.

    Google Scholar 

  10. DA Dillman PG, Tortora R, Swift K, Kohrell J, Berck J, Messer BL. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Soc Sci Res. 2009;38:1–18.

    Article  Google Scholar 

  11. De Leeuw D. To mix or not to mix data collection modes in surveys. J Off Stat. 2005;21(2):233.

    Google Scholar 

  12. Scott A, Jeon S-H, Joyce CM, Humphreys JS, Kalb G, Witt J, et al. A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Med Res Methodol. 2011;11(1):126.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Groves P, Kayyali B, Knott D, Van Kuiken S. The ‘big data’revolution in healthcare. McKinsey Quarterly. 2013;2:3.

  14. Hoque DM, Kumari V, Ruseckaite R, Romero L, Evans SM. Impact of clinical registries on quality of patient care and health outcomes: protocol for a systematic review. BMJ open. 2016;6(4):e010654.

  15. Swedish Health Care, Improved Results in Healthcare Using Quality Registries [cited 2015 11th March]. Available from:

  16. Lannin NA, Anderson C, Lim J, Paice K, Price C, Faux S, et al. Telephone follow-up was more expensive but more efficient than postal in a national stroke registry. J Clin Epidemiol. 2013;66(8):896–902.

  17. Gabbe B, Sutherland A, Hart M, Cameron P. Population-based capture of long term functional and quality of life outcomes following major trauma- the experiences of the Victorian State Trauma Registry. J Trauma. 2010;69(3):532–6.

    Article  PubMed  Google Scholar 

  18. Franklin PD, Lewallen D, Bozic K, Hallstrom B, Jiranek W, Ayers DC. Implementation of patient-reported outcome measures in US total joint replacement registries: rationale, status, and plans. J Bone Joint Surg Am. 2014;96(Supplement 1):104–9.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Breckenridge K, Bekker HL, Gibbons E, van der Veer SN, Abbott D, Briançon S, et al. How to routinely collect data on patient-reported outcome and experience measures in renal registries in Europe: an expert consensus meeting. Nephrol Dial Transplant. 2015;30(10):1605–14.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Basch E, Torda P, Adams K. Standards for patient-reported outcome-based performance measures. JAMA. 2013;310(2):139–40.

    Article  CAS  PubMed  Google Scholar 

  21. Parks KA, Pardi AM, Bradizza CM. Collecting data on alcohol use and alcohol-related victimization: a comparison of telephone and Web-based survey methods. J Stud Alcohol. 2006;67(2):318–23.

    Article  PubMed  Google Scholar 

  22. Shih T-H, Fan X. Comparing response rates in e-mail and paper surveys: a meta-analysis. Educ Res Rev. 2009;4(1):26–40.

    Article  Google Scholar 

  23. Haglind E, Carlsson S, Stranne J, Wallerstedt A, Wilderäng U, Thorsteinsdottir T, et al. Urinary incontinence and erectile dysfunction after robotic versus open radical prostatectomy: a prospective, controlled, nonrandomised trial. Eur Urol. 2015;68(2):216–25.

    Article  PubMed  Google Scholar 

  24. Thorsteinsdottir T, Stranne J, Carlsson S, Anderberg B, Björholt I, Damber J-E, et al. LAPPRO: a prospective multicentre comparative study of robot-assisted laparoscopic and retropubic radical prostatectomy for prostate cancer. Scand J Urol Nephrol. 2011;45(2):102–12.

    Article  PubMed  Google Scholar 

  25. Hocking JSLM, Read T. Postal surveys of physicians gave superior response rates over telephone interviews in a randomized trial. J Clin Epidemiol. 2006;59:521–4.

    Article  PubMed  Google Scholar 

  26. Aki EAMN, Klocke RA. Electronic mail was not better than postal mail for surveying residents and faculty. J Clin Epidemiol. 2005;58:425–9.

    Article  Google Scholar 

  27. Rutherford C, Costa D, Mercieca-Bebber R, Rice H, Gabb L, King M. Mode of administration does not cause bias in patient-reported outcome results: a meta-analysis. Qual Life Res. 2015;25(3):559–74.

  28. Sinclair M, O’Toole J, Malawaraarachchi M, Leder K. Comparison of response rates and cost-effectiveness for a community-based survey: postal, internet and telephone modes with generic or personalised recruitment approaches. BMC Med Res Methodol. 2012;12(1):132.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Szymanski KM, Wei JT, Dunn RL, Sanda MG. Development and validation of an abbreviated version of the expanded prostate cancer index composite instrument for measuring health-related quality of life among prostate cancer survivors. Urology. 2010;76(5):1245–50.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Sampurno F, Ruseckaite R, Millar JL, Evans SM. Comparison of patient-reported quality-of-life and complications in men with prostate cancer, between two modes of administration. Clin Genitourin Cancer. 2015. DOI:

  31. Evans S, Nag N, Roder DM, Brooks A, Millar J, Moretti K, et al. Development of an International Prostate Cancer Outcomes Registry. BJU Int. 2015;doi:10.1111/bju.13258.

  32. Sampurno F, Evans SM. Victorian Prostate Cancer Clinical Registry - Five Year Report 2015 [cited 2016 January 14]. Available from:

  33. Baker JJ. Activity-based costing and activity-based management for health care: Jones & Bartlett Learning. 1998.

    Google Scholar 

  34. Evans SM, Millar JL, Wood JM, Davis ID, Bolton D, Giles GG, et al. The Prostate Cancer Registry: monitoring patterns and quality of care for men diagnosed with prostate cancer. BJU Int. 2013;111(4b):E158–66.

    Article  PubMed  Google Scholar 

  35. Jones B, Jarvis P, Lewis J, Ebbutt A. Trials to assess equivalence: the importance of rigorous methods. BMJ. 1996;313(7048):36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Household Use of Information Technology, Australian Bureau of Statistics, Australia, 2012-13 2014 [cited 2015 1st October]. Available from:

  37. Support ST. Stata Statistical Software: Release 13. College Station: StataCorp LP. StataCorp; 2013.

    Google Scholar 

  38. Lachin JM, Matts JP, Wei L. Randomization in clinical trials: conclusions and recommendations. Control Clin Trials. 1988;9(4):365–74.

    Article  CAS  PubMed  Google Scholar 

  39. Detry MA, Lewis RJ. The intention-to-treat principle: how to assess the true effect of choosing a medical treatment. JAMA. 2014;312(1):85–6.

    Article  CAS  PubMed  Google Scholar 

  40. Sedgwick P. Per protocol analysis. BMJ. 2010;340:c1825.

  41. Edejer TT, Baltussen RM, Adam T, Hutubessy R, Acharya A, Evans DB, Murray CJ. WHO guide to cost-effectiveness analysis. Geneva: World Health Organization; 2003.

  42. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford university press; 2015.

  43. Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477–81.

    Article  CAS  PubMed  Google Scholar 

Download references


We would like to thank Dr Arul Earnest, Associate Professor, Department of Epidemiology and Preventive Medicine School of Public Health and Preventive Medicine of Monash University for assisting us in calculating sample size and generating random numbers. We also would like to thank Dr Nupur Nag, Research Fellow, Department of Epidemiology and Preventive Medicine School of Public Health and Preventive Medicine of Monash University, for assistance in developing the graphics.


Funding for this project has been provided to Associate Prof. Sue Evans by a Monash Partners Academic Health Science Centre Clinical Fellowship grant. DEH has received Monash International Postgraduate Research Scholarship (MIPRS) for tuition fees and Monash Graduate Scholarship (MGS) for living costs and Monash ID: 25762931 for PhD Programme. No funding bodies have any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Availability of data and materials

As this is a study protocol, we are not reporting any data but a sample spreadsheet developed for data collection is available.

Authors’ contributions

DEH, RR, PL and SE contributed in generating ideas for the study. DEH, FS, RR, PL and SE contributed to the development of the study protocol and tools. DEH, SE, RR, FS and PL Contributed in reviewing, revising and finalization of the study protocol. DEH prepared the first draft of the manuscript. SE, FS, RR and PL reviewed and provided subsequent feedback on the revision of the manuscript. All authors critically revised the first draft for content and contributed to the final draft. All authors read and approved the final manuscript.

Competing interests

All the authors declare that they have no competing interests

Consent for publication

As this is a study protocol so we do not require consent of the study participants.

Ethics approval and consent to participate

Our study was built on an existing project which received Ethical approval by the Monash University Human Research Ethics Committee for enrolment of prostate cancer patients in PCOR VIC Registry (approval number CF09/0931 – 2009000436). We obtained separate approval for our study from the Monash University Human Research Ethics Committee (approval number CF15/4157-2015001762). The committee examined and approved all the study materials on November 09, 2015 and approved a minor amendment on March 17, 2016. As per previous ethics approval for PCOR VIC Registry, once patient is diagnosed with prostate cancer, consent was taken for enrolment in the registry as well as consent for follow up data collection. A waiver of consent is provided to enable collection of diagnostic and treatment details on all men with prostate cancer for our study. For men who have not deceased, an opt-out approach is employed. In the current study patient does not require to obtain consent again, however patients have full autonomy to opt out from the study.

Study registration

The study has been registered with Australia New Zealand Clinical Trials Registry and reference number ACTRN12615001369516 and the information were updated on September 19, 2016.

Trial update

Patient enrolment and data collection started on January 29, 2016.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Dewan Md Emdadul Hoque.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoque, D.M.E., Sampurno, F., Ruseckaite, R. et al. Study protocol of an equivalence randomized controlled trial to evaluate the effectiveness of three different approaches to collecting Patient Reported Outcome Measures (PROMs) data using the Prostate Cancer Outcomes Registry-Victoria (PCOR-VIC). BMC Health Serv Res 17, 75 (2017).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: