- Open Access
Developing the first pan-Canadian survey on patient engagement in patient safety
BMC Health Services Research volume 21, Article number: 1099 (2021)
Patient safety is a worldwide problem, and the patient contribution to mitigate the risk of patient harm is now recognized as a cornerstone to its solution. In order to understand the nature of integrating patients into patient safety and healthcare organizations and to monitor their integration, a Canadian survey tool has been co-constructed by patients, researchers and the Canadian Patient Safety Institute (CPSI). This questionnaire has been adapted from the French version of the patient engagement (PE) in patient safety (PS) questionnaire created for the province of Quebec, Canada.
The pan-Canadian PE in PS survey tool was developed in a five-step process: (1) a literature review and revision of the initial tool developed in the province of Quebec; (2) translation of the French questionnaire into an English version tool; (3) creation of a Canadian expert advisory group; (4) adaptation of the English version tool based on feedback from the expert advisory group (assessment and development of the construct’s dimensions, wording assessment and adaptation for pan-Canadian use, technical testing of the online platform for the survey); and (5) pilot testing and pre-validation of the tool before pan-Canadian use.
Results and conclusion
Eight pan-Canadian PE in PS surveys were completed from five Canadian provinces by the expert advisory group and six surveys were completed during the pilot project by participants from different provinces in Canada. This survey tool comprises 5 sections: (1) demographic identification of the participants (Q1 to Q5); (2) general questions (Q6 to Q17); (3) the patient engagement process (experience level of participants and organizational incentives for PE in general) (Q18 to Q33); (4) PE in PS processes, such as current activities, strategies, structures, resources and factors (Q34 to Q67); and (5) the context and impact of PE in PS initiatives in Canadian healthcare organizations (CHOs) (Q68 to Q75), including outcome identification, improvement mechanisms and strategies, evaluation mechanisms, and indicators.
Patient safetyFootnote 1 is a worldwide problem. Among the countries in the Organisation of Economic Cooperation and Development (OECD), one in 10 patients are harmed while receiving hospital care [1,2,3,4], and nearly 50% of such cases are considered preventable . Worldwide, four out of 10 patients are harmed while receiving health care in a hospital setting, and 80% of such cases could have been prevented .
Similar evidence has been found in Canadian hospitals, revealing that “one in fourteen patients suffer from some form of harm, with a third of such cases being preventable” . In addition, the latest evidence in Canada reveals that deaths related to such incidents occur every 13 min . A report called “Measuring Patient Harm in Canadian Hospitals” reveals that, in 2014–2015, harm was experienced by patients during one out of every 18 hospital stays, or 138,000 hospitalizations. Of those, 30,000 (or one in five) involved more than one form of harm . Moreover, medical errors in both the acute and home care settings can cost $6800 per patient, resulting in $2.75 billion in additional costs each year in Canada . Estimated costs related to incidentsFootnote 2 and accidentsFootnote 3 in hospitals represent the costliest form of care, accounting for over $58 billion per year across the country . Similarly, recent evidence demonstrates that 15% of total hospital expenditures and activities in OECD countries is a direct result of adverse events. Estimates show that the total cost of harm in these countries alone amounts to trillions of US dollars every year . One out of every seven Canadian dollars spent on health care is spent treating the effects of patient harm in hospital care . Therefore, it should come as no surprise that investing in the cost of prevention is much lower than the cost of care required due to harm .
Today, it is widely recognized that patient engagement (PE)Footnote 4 can help improve outcomes and reduce the burden on health services and on patient safety [12,13,14,15,16,17,18,19,20,21]. Indeed, partnering with patients for the sake of their own health and care is known to be a key component for developing the highest quality of healthcare [12, 19, 20, 22,23,24,25,26]. This is why implementing PE strategies offers undeniable value to health care systems by helping reduce by up to 15% the burden of patient harm in hospital care, offering potential savings of billions of dollars each year . So it is imperative for healthcare organisations to be able to assess their PE strategy and implementation status in their organisations to gain a better understanding of their PE performance, specifically regarding risk management (RM), for patient safety (PS) .
Patient engagement (PE) has grown in importance as a priority for ensuring quality of care and patient safety (PS) in many Canadian and provincial organizations [28,29,30,31]. The knowledge on the best strategies for building a safer health care system grounded in collaboration between patients and healthcare institutions for PS has not yet been properly synthesized [13, 23, 32]. Such strategies address all parts of the system holistically rather than as silos. There is emerging evidence and leading practices on how to implement PE by involving patients in PS [23, 31, 33], but the impacts of such best practices has not been properly researched and demonstrated [12, 19, 20, 23, 34, 35]. In addition, system-wide identification of PS practices is necessary for better-quality and safer healthcare systems [12, 19, 20, 23, 34, 35]. However, existing PE in PS tools mostly identify initiatives at the clinical, organizational or strategic level, without capturing the whole system (see Table 1 for more information: Adapting questions in the tool with the latest evidence from 2017 to 2020).
In this context, the province of Quebec, Canada created a PE in PS questionnaire in 2017. The questionnaire was designed to assess strategies implemented at the level of the health system to integrate PE in PS practices in healthcare organizations [31, 34]. This tool was validated and used from 2017 to 2019 in all healthcare organizations (n = 24) in Quebec . Knowing that the questionnaire built in Quebec was created in French, CPSI was asked to adapt the tool in the English language to help healthcare managers assess a system-wide integration of PE in PS practices across the rest of the Canadian country and around the world. The tool incorporated concepts of “Safety I” (situations that can go wrong) and “Safety II” (what goes right and the system’s ability to succeed despite conflicts, uncertainties and risks) . It tracks changes over time based on organizational best practices of PE in PS.
The purpose of this article is to present the development of a pan-Canadian survey tool to be used by subject matter experts in PE and PS (PS managers, risk managers or a task group, and patient partners) in order to self-assess the nature of PE in PS structures, strategies and factors at the system level in Canadian healthcare organizations (CHOs) and follow up on improvements in these PE in PS strategies over time. A five-step process was used (see Fig. 1 for more information):
Step 1: Literature review and revision of the initial tool
Step 2: Translation of the French questionnaire into an English version
Step 3: Creation of the Canadian expert advisory group
Step 4: Assessment, adaptation and editing
Step 5: Pilot testing and pre-validation of the tool
In this section, we present the five different steps taken to develop the Pan-Canadian PE in PS survey tool. Please refer to Fig. 1 for the summary of the different phase to build the survey tool.
Step 1: literature review and revision of the initial tool
We performed a literature review to complement the work performed developing the French questionnaire and to capture publications published from 2017 to 2019 regarding best practices in PS and PE and/or evaluation tools to survey PE on PS. Health and social sciences databases (PubMed, Medline, Cochrane, CINAHL, EMBASE) were consulted using the keywords “tool” OR “assessment” OR “measurement” OR “questionnaire” AND “patient engagement” OR “patient participation” OR “patient involvement” OR “patient safety.” We also integrated comments and suggested modifications collected during the final validation phase of the French tool, conducted in the province of Quebec, Canada  and from a study conducted in France  (see Tables 1 and 2 for more information).
The literature review highlighted four tools for evaluating PE and/or PS at different system levels (see Table 1). Among the four tools identified, none tackled both PE and PS at the organizational or system level. The first tool focused on PE in PS at the clinical level, the second tool focused on PE only at the organizational level. The third and fourth tools focused on PE in research methods and its evaluation.
Suggested modifications from previous studies conducted in Quebec and France were also analyzed and integrated into the assessment of the creation of the pan-Canadian PE in PS survey tool (see Table 2 for detailed information). In summary, participants in the Quebec and French studies reported that they generally had a good understanding of the tool and its questions as well as the instructions and the choice of the participating team in answering the questions:
“The tool helps us really frame our strategies and could be used as a self-assessment tool for healthcare institutions [ … ] It will be used for sure.”
“You're asking very pertinent questions, and that helps me.”
“The choice of having a team answer the questionnaire is very important [ … ] It has to be a group that answers the questions. No individual has a comprehensive view of what is going on in the institution.”
At the end of the evaluation of the Quebec and French studies, nine questions were deleted to avoid repetition and the rewording of certain items, and some questions were scaled to improve understanding. Questions 67–73 were repetitions so they were deleted (N = seven repeated questions deleted); two questions pertaining to Family Medicine Groups were also deleted, as they were confusing since not all healthcare organizations did not have Family Medicine Groups and since these questions were specific to the context of the province of Quebec. Other limitations of the previous questionnaire were about the percentages in the questionnaire that were difficult to complete since healthcare organizations did not necessarily know the percentage of engagement of their users in different instances and committees. We thus, modified these sections not to include the percentages, but to just let the participants answer about the degree of involvement of their users (ex: I don’t know, never, sometimes, always, in progress).
Another limitation were about questions on policies and procedures which needed not to just include if the organization had a certain policy or procedure, but also how these policies were integrated and experienced in the organization.
“The absence of policies and procedures does not reflect dedication. Pay attention to the presence of procedures and policies and how they are experienced.”
Modifications were brought to these questions (N = 25 questions on policies and procedures) and clarification were added to the main question. Here is one example:
32. The organization has a formal policy on disclosure
32a. The disclosure policy is periodically evaluated
32b. The disclosure policy is evaluated in partnership with patient advisors?
Step 2: translation of the French tool into an English version
The French tool was translated into English and validated following the methodology (back translation) proposed by the Agency for Healthcare Research and Quality  and the methodology recommended by the United States Bureau of the Census  (see Fig. 2 for more information on the four steps used in the back translation).
The back translation was done in four steps:
Translation of the French tool into an English version by the research team.
Translation of the English version back into the original language by an external resource
Comparing that new translation with the original French tool
And, reconciling any meaningful differences between the two versions and bringing about the corrections.
Thus, the tool was translated from the French version used in the Quebec study  into an English version, and the English version was translated back into French to confirm the terms used. During the translation and the back-translation, we made sure not to change or modify the meaning or depth of the items in order to not affect the validity of the content.
Step 3: creation of a Canadian expert advisory group
To adapt the French version, a Canadian expert advisory group was created to adapt the tool to suit a pan-Canadian context, considering the specific features of Canadian health systems. The criteria used to select members were: their knowledge of and expertise in the Canadian health system, patient engagement and patient safety; having already collaborated with CPSI, and their province of origin (for purposes of representation). An initial list of experts was established by CPSI and the research team, emails were sent to the identified individuals, and a final selection was made by the researchers and CPSI using the selection criteria mentioned above.
In total, eight members from five Canadian provinces were recruited and each of them filled out the survey. Thus having eight surveys completed. The eight members are comprised of: 1 academic, 1 patient representative, 4 quality improvement and patient safety specialists, and 2 experts from Accreditation Canada. The research team in charge of developing the study objectives and methodology had five members (three PhD students, one researcher expert in PE, and one advisor from CPSI as a PS and PE projects expert) (see Table 3). In total the working group had 13 members, met 16 times (the research group met with the expert advisory group 4 times and 12 times alone), and on average the meetings lasted 2–3 h.
Step 4: assessment, adaptation and editing
Step 4.1: assessment and adaptation of the tool content
The Canadian expert advisory group reviewed the initial translated English tool for assessment and adaptation purposes. The expert advisory group were also instructed in their revision of the tool to focus on each question and on a more general aspect of it by keeping in mind the flowing interrogations for content and construct validity,Footnote 5 as well as for and reliabilityFootnote 6:
Wording of the questionnaire?
What is missing or redundant?
Relevance of the questions?
Target population (who can answer the questionnaire)?
Can the questionnaire be used to assess the reality of patient safety in Canada (so that CPSI and the provinces can use the findings to make better decisions and update the PE in PS guide)?
The goal of the initial tool review and assessment by the expert advisory group was to work as a group using a consensus-building approach to evaluate every single dimension of the initial questionnaire, in order to arrive at a consensus on the content and construct validity as well as on the reliability of the entire tool (i.e. so that all the dimensions used in the Canadian survey would be as relevant, reliable, and exhaustive as possible to fully explore PE in PS in Canada). Note that McDowell and Newell (1987) suggested this method as a way of confirming the content validity of a questionnaire when studying an unknown or new phenomenon in a large organizational or geographic context, such as in our case. McDowell and Newell (1987) suggest that questionnaire dimensions are better developed if they are defined and set up on the basis of the consensus, representativeness, relevance, and exhaustiveness of the constituent items of the concept or the topic to be studied [9, 39].
Based on their knowledge of and expertise in Canadian PE in PS, the expert advisory group assessed all the dimensions of the entire initial tool, item by item. When certain items were unclear, incomplete, or inconsistent, the expert advisory group proposed how they could be corrected or further developed, and then, the expert advisory group would agree or disagree as a group and the consensus was calculated democratically by vote. The highest votes will then be selected to reflect the final decision to be brought as a modification in the survey (to note that we did not have any major disagreements. The expert advisory group came to a consensus through a collaborative strategy). Through the assessment and adaptation process, the expert advisory group was able to create, modify, and adjust certain items to reinforce the initial tool’s (the translated English version) validity and consider the latest trends in PE in PS as practised by CHOs. For example, the initial translated English version tool did not have questions covering the leaders’ own perceptions of change, the methods, and the techniques used by organizations to measure and assess the PE in PS outcomes and change. The initial translated English version tool review sometimes led to minor changes to items or simply adaptations, and at other times it led to the creation of new items based on new trends in PE in PS. For instance, a new item was created on the CHOs’ managers’ perspectives on the impacts of PE in PS and which factors most influence PE in PS, whether by enhancing or limiting PE in PS. Other new items were created in the section on demographic characteristics and information on the respondents’ organizations, such as level of experience with the PE approach, competencies in the field, and level of PE understanding.
The assessment and review of the initial translated English version tool was the key stage in the entire tool development process. The content and construct validity resulted in the creation of a complete adapted version of the tool consisting of 75 items in 5 sections on the following 10 dimensions: (1) demographic characteristics, (2) experience level, (3) incentives, (4) strategies, (5) level of intervention, (6) structure and resources, (7) activities, (8) factors, (9) impacts, and (10) improvements (see Table 4). As per the reliability of the survey, all the experts in the expert advisory group when completing the survey for the second time, were able to give the same answer they gave to the questions with minor differences in their answers to new questions or modified questions.
Step 4.2: assessment and adaptation of the wording of the tool for pan-Canadian use
In this step, all the members of the expert advisory group carefully examined the wording of every aspect of the tool and suggested improvements when they found inconsistent expressions and vague vocabulary. In addition, two members of Accreditation Canada (AC) performed a careful reading and a deep examination of the tool’s wording, based on their knowledge of and expertise in Canadian healthcare evaluation standards. Here again, a consensus-building approach was adopted to integrate the feedback and the suggestions provided by all the expert advisory group members on the tool’s wording and language.
At the end of this step, our tool was formally defined as pan-Canadian. This step allowed us to adjust its wording to ensure that it would be understood by all CHOs. The expert advisory group’s comments on the adjustments made to the tool’s wording are found in Appendix A. Please refer to Tables 4 and 5 for more information on the changes made to obtain the final version of the pan-Canadian PE in PS survey.
Step 4.3: editing and assessment of technical aspects
This stage was focused on placing the questionnaire on the online platform, testing the technical aspects, and revising the questionnaire before the pilot test. The research team received specific training from the information technology staff at CPSI on how to manage and edit on the online platform. Then the online tool was internally tested by the members of the research team.
At the end of this stage, the questionnaire was set up online, approved by the working group, and considered ready for use in the pilot test. Please refer to Table 5 to see how the questionnaire was developed and adapted from the initial version (French version) to the final version (pan-Canadian version). In addition, please refer to the following link for the pan-Canadian survey, available on the CPSI online platform: https://survey.patientsafetyinstitute.ca/n/zz16p.aspx
Step 5: pilot testing and pre-validation of the tool
In this final phase, we tested and validated the tool among real CHOs. To this end we asked members of the National Health Engagement Network (NHEN), a community of practice, to participate in our pilot test. Once some members had agreed to participate and had given their consent to help test the survey, an email was sent to them explaining the instructions for completing the questionnaire along with the link to the online survey.
The questionnaire was completed in September 2020 by six organizations: 2 in British Columbia, 2 in Ontario, and 2 in Newfoundland. Among these 6 organizations, 3 have a mandate to provide acute care, 2 provide long term care, and 1 is specialized in mental health care. For each organization, the tool was completed simultaneously by a team of three members (one manager in charge of quality and risk management, one person in charge of PE, and one patient advisor). The average time to complete the questionnaire was 52 min, with a maximum of 67 min and a minimum of 27 min.
Once all the responses had been received, the research team exported and analyzed the results on CPSI’s online platform dedicated to the collection and processing of survey data. Based on the pilot test results and participants’ comments, the research team made the necessary adjustments and amendments directly in the tool and emailed it along with the pilot test results to the members of the expert advisory group for final review and approval. Then, all expert advisory group members reviewed the pilot test results, revised the entire tool, approved the changes and adjustments, and gave their final approval. As per the validity and reliability of the survey, the participants were able to complete the survey as per the expert advisory group. We were able to see a consistency in the type of answers giving to a specific question.
Following the pilot test, the tool was considered ready to be used officially in the final validation step: “at the pan-Canadian level.” Table 6 presents the tool items that were modified, adjusted, or adapted based on the pilot test results.
Table 5 shows the final sections (layout) of the pan-Canadian PE in PS tool.
The Pan-Canadian PE in PS survey is an innovative tool to help self-assess the nature of PE in PS structures in CHOs and to monitor changes over time. To our knowledge, no similar tool exists in Canada or elsewhere in the world to identify strategies and initiatives related to PE in PS at a system level. To test its validity, the pan-Canadian PE in PS survey tool was reviewed by an expert advisory group and tested in a pilot test (see Step 5 of the methodology development process).
This article presents a description of the five-step process used to adapt, develop, translate and validate an existing tool on patient engagement (PE) in patient safety (PS), which was co-constructed with patients in the CHOs. The pan-Canadian PE in PS survey tool, intended as a self-assessment tool to be used by subject matter experts in PE and PS who integrate patients, was developed in five steps: (1) a literature review and revision of the French tool; (2) translation of the French questionnaire to English; (3) creation of a working group; (4) assessment, adaptation and editing; and (5) pilot testing and pre-validation of the tool. A preliminary step was also conducted to validate the tool’s content validity (Step 0).
The final version of the PE in PS pan-Canadian survey tool comprises of 75 questions divided into four sections with ten dimensions: Section 0 contains questions for demographic identification of the participants (Q1 to Q5); Section 1 (Q6 to Q17) has general questions to establish participants’ level of experience and organizational incentives for PE in PS; Section 2 (Q18 to Q33) contains questions related to PE processes, such as strategies, activities, structures, resources and factors; Section 3 (Q34 to Q67) has questions on PE in PS processes, such as activities, strategies, structures, resources and factors in place; and Section 4 (Q68 to Q75) contains questions on the context and impact of PE in PS initiatives in the CHOs. More specifically, these questions are focused on outcome identification, improvement mechanisms and strategies, evaluation mechanisms, and indicators.
The added value of the pan-Canadian PE in PS survey tool
The research team identified six forms of added value provided by the pan-Canadian PE in PS survey tool. First, this is the only self-assessing tool that identifies PE in PS at a system level in healthcare organizations. Based on our research and to our knowledge, no such tool exists at a system level, either in Canada or elsewhere in the world. Second, the tool informs policy and strategic decisions at a national level. At that level, leaders are able to understand the spread and depth of PE in PS across Canada in order to demonstrate what works, which in turn will strengthen the commitment to safe care (by offering evidence-based programs, thereby contributing to one of the five goals of an exceptional healthcare system, as set out in the Canadian Quality and Patient Safety (CQPS) framework ). At the provincial level, the tool allows leaders to understand PE in PS in their jurisdictions and how it compares with that of other provinces in order to focus and coordinate their efforts. At the organizational/operational level, the tool allows leaders to understand what works and to implement the practices that can most effectively improve safety. Third, the tool informs practice, identifying the factors, mechanisms, and strategies that effectively improve patient safety through engagement (reduce and prevent harm, reduce the economic burden of patient safety incidents). Fourth, the tool promotes partnering with patients to improve patient safety at the organizational level, and but also to improve care safety at all system levels in Canada. Fifth, the tool and process can be transferred for use in different contexts around the world. Sixth, the tool helps in the CHO accreditation preparation process (e.g. as a survey instrument, a component of the QmentumFootnote 7 program of Accreditation Canada).
Strengths of the tool development process
First of all, the tool was adapted from an existing tool tested in a very interesting study conducted in the province of Quebec . This helped create a solid foundation for our tool development process. Second, the creation of the expert advisory group was a tremendous strength in the process used to develop the survey tool. The remarkable expertise and knowledge in PE and PS among the members of the expert advisory group, and the fact that they came from different provinces and worked at different management levels and strategic positions in the CHOs, helped us by enhancing the content validity but also by reinforcing the overall methodology (see Table 3 for more information). And lastly, the involvement of Accreditation Canada (AC) was a great asset, especially in terms of structuring our methodology, defining and selecting the right wording, and connecting with CHOs for the pilot project.
Five limitations of this study were identified during the development of the pan-Canadian PE in PS survey. The first is the fact that an expert translator was not used to translate the initial tool from French to English. However, the research team and the expert advisory group were able to use a back translation method to interpret and adapt the wording to the survey’s pan-Canadian context and review the terms frequently employed by the CHOs in their work environments. The second limitation, which is related to the first, concerns understandings of certain terms. Even though we worked closely with many Canadian experts active in different Canadian heath systems, we believe that this added value resulted in different meanings being ascribed to certain wordings and definitions. For this reason, we incorporated common definitions of certain words that we found differed from one province or CHO to another. We also believe that such discrepancies were few in number. The third limitation concerns the fact that only one patient partner was involved as a member of the expert advisory group. However, the patient partner belongs to a patient organization where the individual has access to an extensive patient partner network. The fourth limitation involves the ability of healthcare professionals to facilitate patient interaction and participation by encouraging patients to ask questions related to patient safety and take an active part in their care and in the healthcare system. Further research will need to identify strategies engage patients in the process of engaging patients to participate in completing surveys in a team setting .
The fifth limitation concerns the requirement of having a group of three people (patient safety participant, patient engagement participant, and a resource patient or patient partner) complete the survey together. This could be a major issue for the survey as it becomes more widely used across Canada. While this may add value, it also reduces the chances that the survey will be completed, resulting in a potentially lower response rate. We nevertheless kept this requirement of a group of three people completing the PE in PS survey tool, because of the importance of receiving feedback from the various departments of CHOs.
The task of developing a new tool by adapting or translating an existing tool into another language and broader context might seem overwhelming. Perhaps the greatest challenge was to produce a tool that is linguistically comprehensible, psychometrically sound, and efficient and effective for use in organizational research settings. This article provides a description of the process used to develop, translate and validate an existing tool for investigating how to engage patients (PE) in patient safety (PS) within Canadian healthcare organizations (CHOs).
The tool is currently being used by healthcare organizations in Quebec and France . A version in Portuguese is currently being prepared to assist healthcare managers in monitoring changes in PE in PS at the system level.
Above all, it must be said that such a tool can meet the WHO’s need to identify and compare PE in PS initiatives around the world. The PE in PS tool that we have created therefore has the potential to help health care organizations identify gaps in their PE in PS as a way to reduce incidents and accidents related to errors by integrating PE into their safety practices. It will also give health care organizations access to a database of recognized international PE in PS practices and strategies, so that they can improve their practices and monitor improvements over time.
The next step in the pan-Canadian PE in PS tool will be use in an official pan-Canadian final validation study in CHOs.
Availability of data and materials
All data generated or analysed during this study are included in this article, and the end result is the PE in PS Pan-Canadian survey tool which is available in English: https://survey.patientsafetyinstitute.ca/n/zz16p.aspx
Patient safety: The pursuit of the reduction and mitigation of unsafe acts within the health care system, as well as the use of best practices shown to lead to optimal patient outcomes. Patient safety is one of the dimensions of quality. From: https://www.patientsafetyinstitute.ca/en/toolsResources/Patient-Engagement-in-Patient-Safety-Guide/Pages/Glossary-of-Terms.aspx
Incidents will be defined here as no-harm incidents: A patient safety incident that reached a patient, but no discernible harm resulted. From: https://www.patientsafetyinstitute.ca/en/toolsResources/Patient-Engagement-in-Patient-Safety-Guide/Pages/Glossary-of-Terms.aspx
An “accident” is a situation in which harm was caused and damage occurred .
The definition this study will abide by is one of “Patient Engagement (PE)”, close to the definition of patient partnership, which is defined as patients, families, their representatives, and health professionals working in active partnership, and engaged at various levels across the health care system – clinical level, organizational level and strategic level, − to improve health care and social care as well as patient safety .
Content validity: This category looks at whether the instrument adequately covers all the content that it should with respect to the variable. In other words, does the instrument cover the entire domain related to the variable, or construct it was designed to measure? Construct validity refers to whether you can draw inferences about test scores related to the concept being studied
(Roberta Heale & Alison Twycross. Validity and reliability in quantitative studies, 2015. https://ebn.bmj.com/content/ebnurs/18/3/66.full.pdf).
Reliability relates to the consistency of a measure. A participant completing an instrument meant to measure motivation should have approximately the same responses each time the test is completed and among other participants (Roberta Heale & Alison Twycross. Validity and reliability in quantitative studies, 2015. https://ebn.bmj.com/content/ebnurs/18/3/66.full.pdf).
Qmentum is a globally developed, locally tailored accreditation program supported by staff and survey experts who have extensive experience in health care at all levels, all around the world. It is designed specifically to help organizations to build resources and capacity, strengthen basic structures and processes related to quality and safety, and help them take part in an accreditation program (https://accreditation.ca/accreditation/qmentum/).
Canadian Patient Safety Institute
Canadian Healthcare Organizations
Organization for Economic Co-operation and Development
National Health Engagement Network
Canadian Quality and Patient Safety
World Health Organization
WHO, «Global priorities for patient safety research,» 2009. [En ligne]. Available: http://apps.who.int/iris/bitstream/handle/10665/44205/9789241598620_eng.pdf;jsessionid=86A5 928D299B2CC2B9EBAA241F34663D?sequence=1.
WHO, «Patient safety- Global action on patient safety. Report by the Director-General,» 2019. [En ligne]. Available: https://apps.who.int/gb/ebwha/pdf_files/WHA72/A72_26-en.pdf,.
WHO, «Quality of care: patient safety. Report by the Secretariat (A55/13),» 2002. [En ligne]. Available: https://www.who.int/patientsafety/worldalliance/ea5513.pdf?ua=1&ua=1.
Slawomirski L, Auraaen A, Klazinga N., «The Economics of Patient Safety in Primary and Ambulatory Care: Flying blind.,» 2018. [En ligne]. Available: https://doi.org/10.1787/baf425ad-en.
de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17(3):216–23. https://doi.org/10.1136/qshc.2007.023622https://www.ncbi.nlm.nih.gov/pubmed/18519629.
Baker G, Norton P, Flintoft V, Blais R, Brown A, Cox J, et al. The Canadian adverse events study: the incidence of adverse events among hospital patients in Canada. Can Med Assoc J. 2004;170(11):1678–86. https://doi.org/10.1503/cmaj.1040498.
Canadian Patient Safety Institute (CPSI), «The Case for Investing in Patient Safety in Canada.,» 2017. [Online]. Available: Risk Analytica: http://www.patientsafetyinstitute.ca/en/toolsResources/case-for-investing-in-patient-safety/Pages/default.aspx.. [On July 2018].
Canadian Patient Safety Institute (CPSI), «Hospital Harm Mesure,» 2016. [En ligne]. Available: http://www.patientsafetyinstitute.ca/en/toolsresources/hospital-harm-measure/pages/default.aspx. [On July 2018].
Dowell I. Measuring health. Oxford: Oxford University Press; 1987.
Canadian Institute for Health Information (CIHI), «National Health Expenditure Trends, 1975 to 2011.,» 2011. [Online]. Available: http://secure.cihi.ca/ cihiweb/products/HCIC_2010_Web_e.pdf.. [On January 2017].
T. Jackson, «One dollar in seven: Scoping the Economics of Patient Safety.,» 2009. [Online]. Available: https://www.patientsafetyinstitute.ca/en/toolsResources/Research/commissionedResearch/EconomicsofPatientSafety/Documents/Economics%20of%20Patient%20Safety%20Literature%20Revi ew.pdf.
Pomey, et al. The participation of patients and relatives in Quebec’s Health System: The Montréal Model in Patient engagement: How patient-provider partnerships transform Healthcare organizations.,» New SHOC Monograph Series: Organisational Behaviour in Healthcare (Editor Pomey, M.P.., Dumez V et Denis JL.) Palgrave editor. https://www.palgrave.com/gp/book/9783030141004; 2019. p. 17–60.
Baker GR, Denis JL, Pomey M-P, MacIntosh-Murray A. Designing effective governance for quality and safety in Canadian healthcare. Healthc Q. 2010;13(1):38–45.
Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;%1 de %23(1). https://doi.org/10.1136/bmjopen-2012-001570.
Duckers M, Faber M, Cruijsberg J, Grol R, Schoonhoven L, Wensing M. Safety and risk management interventions in hospitals: a systematic review of the literature. Med Care Res Rev. 2009;66(6 Suppl):90S–119S. https://doi.org/10.1177/1077558709345870.
Organization for economic co-operation and development (OECD). Vers des systèmes de santé plus performants. Paris: http://www.oecd.org/els/health-systems/31785551.pdf: OECD; 2004.
O'Leary DS. Patient safety: the search for global solutions. World Hosp Health Serv. 2008;44(1):19–21. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/18549029.
Richards T, Montori V, Godlee F, Lapsley P, Paul D. Let the patient revolution begin. BMJ. 2013:346. https://doi.org/10.1136/bmj.f2614.
Pomey M-P., Langlet M-F., "L’innovation du point de vue du patient-famille et du citoyen in L'innovation en santé. L'innovation en santé: réfléchir, agir et valoriser sous la direction de Fabrice Brunet et Kathy Malas," (2ème édition) Éditions du CHU Sainte-Justine, pp. https://www.editions-chu-sainte-justine.org/livres/innovation-sante-365.html, 2019.
Pomey M-P., Dumez V., Denis J. L., "Patient engagement: How patient-provider partnerships transform Healthcare organizations.," New SHOC Monograph Series: Organisational Behaviour in Healthcare. Palgrave editor. https://www.palgrave.com/gp/book/9783030141004, p. https://www.palgrave.com/gp/book/9783030141004 , 2019.
Pomey MP, Dumez V, Denis JL. The participation of patients and relatives in Quebec’s Health System: The Montréal Model in Patient engagement: How patient-provider partnerships transform Healthcare organizations.," New SHOC Monograph Series: Organisational Behaviour in Healthcare (Editor Pomey, M.P.., Dumez V et Denis JL.) Palgrave editor. https://www.palgrave.com/gp/book/9783030141004; 2019. p. 17–60.
Pomey M-P, Flora L, Karazivan P, Dumez V, Lebel P, Vanier M. C, Jouet E, et al., «The Montreal model: the challenges of a partnership relationship between patients and healthcare professionals.,» Sante Publique, vol. 27(1 Suppl): http://www.ncbi.nlm.nih.gov/pubmed/26168616., pp. p. S41–S50., 2015.
Bombard Y, Baker R, Orlando E, Fancott C, Bhatia P, Onate K, et al. Engaging patients to improve quality care: A systematic review. Implement Sci. 2018;13(1):98. https://doi.org/10.1186/s13012-018-0784-z.
National Health Service (NHS), «High Quality Care For All -Next Stage Review Final Report.,»44 (1), 19-21. 2008. [Online]. Available: http://www.ncbi.nlm.nih.gov/pubmed/18549029.
Patient Engagement Action Team., «Engaging Patients in Patient Safety – a Canadian Guide.,» 2018. p. 63. [Online]. Available: http://www.patientsafetyinstitute.ca/en/toolsResources/Patient-Engagement-in-Patient-Safety-Guide/Pages/default.aspx.. [Accès le June 2018].
Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med. 1991;324(6):377–84. https://doi.org/10.1056/NEJM199.
Aho-Glélé U, Bouabida K, Pomey M-P. État des lieux sur la gestion des risques et la sécurité des soins et des services au Québec: évolution, exemples et recommandations. Risques Qualité J. 2019;4(16):214–24. https://doi.org/10.25329/rq_x.
Ministère de la Santé et Services sociaux (MSSS). Cadre de référence de l’approche de partenariat entre les usagers, leurs proches et les acteurs en santé et en services sociaux.,» Gouvernement du Québec: Accessible à: https://publications.msss.gouv.qc.ca/msss/fichiers/2018/18-727-01W.pdf (Consulté le 12-12-2019). Quebec; 2018. p. 46.
Accreditation Canada, «Strategic plan 2014–2016.,» 2016. [En ligne]. Available: https://accreditation.ca/sites/default/files/strategic-plan-2014-16-en.pdf.. [Accès le July 2018].
Agrément Canada. Les soins centrés sur l’usager et la famille-Quality Matters - Qmentum pour une meilleure santé. 2015; 2015. p. 3–5. [En ligne]. Available: https://accreditation.ca/sites/default/files/qm-2015-fall-winter.pdf.. [Accès le July 2018]
Canadian Patient Institute for Safety (CPSI), «Équipe d’Action Engagement patient. Le Guide canadien de l’engagement des patients en matière de sÉcuritÉ.,» Mai 2017. [En ligne]. Available: Accessible à: www.patientsafetyinstitute.ca/EngagingPatients et www.patientsafetyinstitute.ca/fr/toolsresources/Patient- Engagement-in-Patient-Safety-Guide/Pages/default.aspx (ConsultÉ le 29-11-2017).
Pomey M-P, M.E, Neault C, Biron V, Houle L, Blais C, et al. Patient advisors: how to implement a process for involvement at all levels of governance in a healthcare organization? Patient Experience J. 2016.
Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient And Family Engagement: A Framework For Understanding The Elements And Developing Interventions And Policies. Health Aff. 2013;32(2):223–31.
Aho-Glele U, Pomey M-P, Gomes de Sousa MR, Bouabida K. An evidence-based tool (PE for PS) for healthcare managers to assess patient engagement for patient safety in healthcare organizations. Patient Exp J. 2021;8(1):7. https://doi.org/10.35680/2372-0247.1454.
Vincent C, Amalberti R. Safer Healthcare: Strategies for the Real World. 2016, vol. %1 de %2. Heidelberg New York Dordrecht London: Springer Cham; 2016. p. 170. https://doi.org/10.1007/978-3-319-25559-0, ed. I. 978–3–319-25557-6.
Hollnagel E, Leonhardt J, Licu T, Shorrock S. From Safety-I to Safety-II: A White Paper. Bruxelles, BE: Eurocontrol; 2013.
Barnay A, Aho-Glele U, Moret L, et al. Stratégie d’engagement des usagers dans la sécurité des soins: un état des lieux dans les CHU français. Risques Qualité. 2020;17(1):15–22.
Asunta P, Viholainen H, Ahonen T, Rintala P. Psychometric properties of observational tools for identifying motor difficulties – a systematic review. BMC Pediatr. 2019;19:322. https://doi.org/10.1186/s12887-019-1657-6.
Nunnaly JC. Psychometric theory, vol. 02. New York: Me Grawhill Book company; 1978.
HSO and CPSI Joint Commitment. «The Canadian Quality & Patient Safety Framework for Health Services,» Copyright © 2020. In: Health Standards Organization, Canadian Patient Safety Institute, and their respective licensors: All rights reserved_ISBN: 978–1–926541-88-4; 2020.
Ericsson C, Skagerström J, Schildmeijer K, et al. Can patients contribute to safer care in meetings with healthcare professionals? A cross-sectional survey of patient perceptions and beliefs. BMJ Qual Saf. 2019;28:657–66. https://doi.org/10.1136/bmjqs-2018-008524.
We warmly thank The University of Montreal, CPSI & Accreditation (AC) /HSO. and all the following members: (1) Maiana Regina Gomes de Sousa (Ph.D. Student at Federal University of Goiás, Brazil); (2) Louise Clément (Executive Director, AC/HSO); (3) Nelea Lungu, Regional Director, AC/HSO). (4) Many thanks to all the advisory group members (Allison Kooijman, Lisa Hawthornthwaite, Jodi Ploquin, Susan Dunn, Patricia Trbovich, and, Benoit Tétrault), for their precious advice and contribution in developing the PE in PS Pan-Canadian survey tool.
Participants consent information
We receive a written consent from all the six participants from our pilot study project which are also included in ongoing study project research. All the authors also approved the publication of the article.
Authors’ information (optional)
University of Montreal1, CRCHUM2, Patient For Patient Safety Canada (PFPSC)3, Canadian Patient Safety Institute (CPSI)4, Blue Water Health5, Alberta Health Services6, Nova Scotia health authority7, University of Toronto8, CISSS Laval9, Federal University of Goiás, Brazil10, Accreditation Canada/Health Standards Organization11
Funded by the CPSI (Canadian Patient Safety Institute). The role of CPSI is to advance knowledge and practice in the field of patient safety in Canada and around the world. CPSI was represented in this study by their contribution in the research group in structuring the methodology used in the adaptation of the survey.
Ethics approval and consent to participate
The research protocol has been approved by the Ethic committee of the Centre de Recherche du Centre Hospitalier de l’Université de Montréal, which also approves studies involving humans: № CÉR CHUM: 20.009. The study was also carried out in accordance with relevant guidelines and regulations. In addition, Informed consent was obtained from all participants.
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Research commissioned by the Canadian Patient Safety Institute (CPSI) and Patients for Patient Safety Canada (PFPSC) and led by Université de Montréal (UdM)
About this article
Cite this article
Aho-glele, U., Bouabida, K., Kooijman, A. et al. Developing the first pan-Canadian survey on patient engagement in patient safety. BMC Health Serv Res 21, 1099 (2021). https://doi.org/10.1186/s12913-021-07089-6
- Patient engagement
- Risk management
- Patient safety