We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
French cross-cultural adaptation of the Organizational Readiness for Implementing Change (ORIC)
BMC Health Services Researchvolume 19, Article number: 535 (2019)
Organizational readiness is a factor known to influence the predisposition of individuals within an organization to change. Based on Weiner’s organizational theory, the “Organizational Readiness for Implementing Change” (ORIC) questionnaire was developed and validated to measure organizational readiness in healthcare contexts. However, no such tools allow French-speaking organizations to measure this concept. The objectives of this study were to (1) conduct a French cultural adaptation of the ORIC questionnaire, and (2) initiate the study of its psychometric properties.
(1) Cross-cultural adaptation and translation processes were first conducted with the methodologies of Beaton, Vallerand and Massoubre. (2) Subsequently, internal consistency was documented by calculating Cronbach’s alpha and inter-item and item-to-scale correlations. The study of construct validity was initiated with a confirmatory factor analysis.
A French 10-item scale named the Réceptivité organisationnelle à l’implantation d’un changement (ROIC) was developed and pretested by 125 occupational therapists working in Quebec homecare services. Cronbach’s alpha values for the 2 item subscales show satisfactory internal consistency (Commitment: α = 0.84 and Efficacy: α = 0.86). Inter-item correlations revealed that the ROIC’s items are moderately related to each other while item-to-total scale correlations pinpoint items that accounts for variance and influence internal consistency. Confirmatory factor analysis allowed the initiation of a substantial documentation of ROIC’s model fit with the original version (CFI = 0.89, TLI = 0.85, SRMR = 0.08, and RMSEA = 0.12).
The ROIC is a new theory-based and translated questionnaire that can be used to rigorously document the organizational readiness of French organizations. The ROIC has the potential to support members of different organizations in the identification of subsequent efforts for the implementation of a change.
Contextual characteristics are well-recognized for their potential to significantly influence the implementation of interventions [1,2,3]. Among these characteristics, organizational readiness has been studied because of its critical impact on the subsequent stages of the change process [4,5,6,7]. Some authors have identified organizational readiness as one of the strongest predictors/facilitators for the adoption of new practices, policies and programs [8, 9].
Armenakis et al. (1993) initially suggested that the assessment of individuals’ readiness to change in an organization is a good opportunity to gain insight into their beliefs and attitudes regarding the necessity (or not) of implementing a change, and into the organization’s capacity to implement it with success . The concept of organizational readiness covers characteristics related to individuals (e.g., motivation, commitment, self-efficacy) that are well-recognized for their influence on implementation of a change [11,12,13]. According to Weiner’s organizational theory, organizational readiness is defined as the extent to which members of an organization are psychologically and behaviorally prepared to implement a change in their setting . These definitions highlight the overlap between the organizational and individual characteristics underlying the multilevel aspect of organizational readiness. An approach that considers both contextual- and individual-specific assessments of readiness is highly recommended when planning and conducting knowledge translation (KT) efforts aimed at optimizing the benefits of the applied change [11, 15,16,17]. Organizational readiness can therefore allow to document the interplay of these characteristics in a KT process.
The study of organizational determinants related to the KT process and strategies used to enhance organizational readiness has been initiated in the scientific literature [17, 18]. However, faced with the paucity of validated tools to measure an organization’s readiness for change [9, 19], particularly within a KT perspective in healthcare contexts , Shea and colleagues (2014) developed and validated the “Organizational Readiness for Implementing Change” (ORIC) questionnaire . The ORIC is based on Weiner’s organizational theory (2009), and describes two main facets of organizational readiness: (1) change commitment and (2) change efficacy . The ORIC aims to document an organization’s level of readiness to implement change as perceived by its members, in order to guide them in the identification of strategies and resources relevant to the context . The ORIC is comprised of 10 items divided into two main subscales: (1) five items on change commitment (i.e., do the intended members of the organization want the change?) and (2) five items on change efficacy (i.e., are the intended members of the organization able to change?). Each of these items is scored using a 5-point Likert scale ranging from “Disagree” to “Agree”. Studies of its psychometric properties support its content validity (i.e., content adequacy); construct validity (i.e., factor structure with exploratory and confirmatory factor analysis); and reliability (i.e., inter-rater reliability and inter-rater agreement) in both laboratory and organizational contexts. For example, the reliability of the original version of the ORIC has been documented to inform the variability of perception from an individual- and group-level perspective . The initial 12-item version of the ORIC was revised following the psychometric research reported by Shea et al. (2014). Two items related to the Efficacy subscale were removed because of their interpretation about motivation, a concept related to the Commitment subscale according to the participants’ perspective. The 10-item version of the ORIC subsequently became the recommended English version, as it only contains the items that most strongly correspond to the two components initially defined for the measurement of organizational readiness .
Studies from different health sectors (e.g., pain management, pharmacological and dental care) have since used the 10-item version of the ORIC to document the perception of readiness among members of an organization [20,21,22]. For example, Sanders et al. (2017) found it useful to use the ORIC to identify healthcare students’ perceptions and concerns about an immersion program in direct patient care and to guide qualitative data collection in mixed methods research that focuses on the underlying concepts of organizational readiness . However, to our knowledge, the French tools documenting organizational characteristics are not based on the underlying conceptualization described above. Rapid and valid screening of organizational readiness should be extended to French organizations to support the identification of their members’ readiness regarding the implementation of a change, thus maximize their chances of success. As such, the aims of this study were to (1) translate and culturally adapt the ORIC questionnaire in French for Canadian organizations, and (2) initiate the study of its psychometric properties.
Operational model and context of the study
The cross-cultural adaptation process of the ORIC took place in the context of a larger KT study that aimed to analyze the KT process of a clinical algorithm disseminated in Quebec (Canada) homecare services. The evidence-based algorithm, called “Algo”, was devised to support occupational therapists and non-occupational therapists (e.g., home health aides) in using skill mix during the process of allocating bathing equipment to patients struggling with hygiene care . Algo was developed within an integrated KT approach to facilitate its utilization by stakeholders of the healthcare system. The operational model “integrated-Promoting Action on Research Implementation in Health Services” (i-PARIHS) was used to document the characteristics related to its utilization among different individuals and contexts . According to the i-PARIHS operational model, the barriers and facilitators to a KT process can be associated with either individual characteristics, context, or innovation . In this perspective, organizational readiness can help document both the individual characteristics and the contextual climate present within the organizations. The ORIC therefore has the potential to support the identification of barriers and facilitators related to the members of an organization that are involved in the implementation of a change.
A cross-cultural adaptation process of the English version of the ORIC developed by Shea et al. (2014)  was conducted based on the six steps of Beaton’s methodology  and complemented by Vallerand procedures . In addition, Massoubre et al.’s (2002) procedure was used following the expert committee review to help document the different types of equivalences (i.e., semantical, technical, idiomatic, related to experience, and conceptual) .
Cross-cultural adaptation procedure
Step 1: Forward translation
The first step of the process consists of a forward translation of the ORIC from the source language (i.e., English) to the target language (i.e., French). As recommended by Beaton et al. (2000) and Vallerand (1989), two independent bilingual translators (i.e., Forward1 and Forward2) each completed a first forward translation of the ORIC into their mother tongue (i.e., French). Translators Forward1 and Forward2 had different backgrounds (i.e., Forward1: Master’s in Urban Planning with statistical expertise and Forward2: bachelor’s degree in Translation), as well as different levels of professional experience (Forward1: 21 years and Forward2: 3 years).
Step 2: Synthesis of the forward translation
This step involved synthesizing the two French versions of the ORIC produced by the translators (Forward1 and Forward2) into one common preliminary version. A conference call moderated by the first author allowed Forward1 and Forward2 to discuss each translation difference. Consensus between the two translators was reached for most of the differences. For the remaining differences, the research team considered the interpretation of the translators and consulted the French scientific literature in the field of organizational change to reach a consensus regarding the final wording.
Step 3: Back translation
As recommended by Beaton et al. (2000) and Vallerand (1989), two backwards translations were then completed by two other independent translators (Back1 and Back2). The independence between the translators from steps 1 and 3 helped to rigorously document the adequacy of the chosen terms for the formulation used in the original version of the questionnaire . Contrary to step 1 (Forward translation), the translators selected for step 3 were required to have English as their mother tongue, and to have no expertise in the field covered by the questionnaire (i.e., organizational readiness). Back1 and Back2 translators had similar profiles (i.e., bachelor’s degree in Translation) and similar levels of professional experience (i.e., 25 years each). A first pre-final French version of the ORIC, based on the Forward1, Forward2, Back1 and Back2 versions of the questionnaire, was produced in preparation for an expert committee meeting.
Step 4: Expert committee review
The expert committee members (n = 5) invited to review the French version of the ORIC included (a) three researchers participating in this study (including the third author, who has extensive experience in the field of translating tools [MR; MG; JD]); (b) a specialized translator in the field of healthcare (not involved in previous steps of the translation nor in the research process [MG]); and c) a psychologist with expertise in work organization (field covered by the ORIC [CD]). The committee composition was therefore compatible with the first type (i.e., researchers only) described by Vallerand (1989). The meeting was recorded for further data analysis.
Step 5: Pretesting of the French version of the ORIC
As previously specified, the cross-cultural adaptation process of the ORIC aimed to further document the organizational readiness related to a larger study (i.e., analysis of the KT process of a clinical algorithm deployed in Quebec homecare services since 2013) conducted with French Canadian occupational therapists. Prior to the pretest, the pre-final French version of the ORIC was tested with a convenience sample of 9 French-speaking Canadians (i.e., 2 healthcare managers and 7 occupational therapists) using the “think aloud technique” . The “think aloud technique” highlighted the need to define the phrase “People who work here […]” used at the beginning of each item, when completing the questionnaire. Items were otherwise well understood by participants.
For the pretest of the French version of the ORIC (step 5), the target population was defined as occupational therapists who were members of the Ordre des ergothérapeutes du Québec (provincial regulatory body) working in homecare services (n = 886). Since 99 of them had not consented to be part of research studies or provided an e-mail address where they could be contacted, a sample of 787 occupational therapists received an e-mail invitation on September 25th, 2015 containing the link to the electronic platform LimeSurvey (reminder on February 4th, 2016) where the French version of the ORIC was presented. The survey was active for as long as participants continued to answer (data were collected up to March 24th, 2016). No exclusion criteria were considered for this cross-cultural adaptation process. Informed consent was obtained from each participant prior to data collection, on the first page of the survey platform (ethics approval MP-22-2016-532). The respondents had the opportunity to add comments below each item of the French version of the ORIC (e.g., to report unclear sentences).
Step 6: Submission and appraisal of reports by committee
Throughout the French cross-cultural adaptation process of the ORIC, the authors communicated by e-mail with the authors of the original English version. These exchanges led us to select the 10-item version of the questionnaire for the cross-cultural adaptation process in French, as per their recommendation, and allowed us to obtain clarifications when needed (e.g., meaning of a word).
For the cross-cultural adaptation process, all translation results from steps 1 (Forward translation) and 3 (Back translation) were grouped into tables to facilitate comparison and discussion in steps 2 (Synthesis of translation) and 4 (Expert committee review). Following the completion of step 4, recorded exchanges between the experts were transcribed and transferred to the NVivo 10 platform (QSR International Pty Ltd; Australia). Each transcript was analyzed and coded according to the type of equivalence (i.e., semantical, technical, idiomatic, related to experience, and/or conceptual) to which it referred, as per the classification of Massoubre et al. (2002) .
Descriptive statistics were first used for the characteristics of the respondents in step 5 (Pretest). A chi-square for one sample was calculated for the two variables for which information was available from the professional regulatory board: (1) the gender and (2) the administrative region of professional practice. For the second variable, 95% confidence intervals (normal approximation) were calculated for each frequency in order to identify the proportion(s) of the sample that were not representative of the population. Item-level descriptive statistics were also calculated to identify missing and out-of-range data . The internal consistency (i.e., degree of homogeneity) for each of the two subscales (5 items per subscale) of the French version of the ORIC was determined using Cronbach’s alpha coefficient (α). The interpretation cut-off scores of DeVellis et al. (2003) were used to appreciate the degree of homogeneity (i.e., 0.70 ≥ α ≤ 0.90). Inter-item correlations were calculated to ensure a minimal association between items . An average value situated between 0.15 and 0.50 was considered “good” to ensure items were not redundant but still related to the overall concept measured by the questionnaire . Parallel to these calculations, item-to-scale correlations of the French version of the ORIC were conducted to verify each item’s adequacy in individually contributing to the homogenous measurement of the construct of organizational readiness, while maintaining sufficient variance .
Finally, a confirmatory factor analysis was conducted with the SAS software 9.4 (CALIS procedure) to initiate the documentation of the French version of the ORIC’s construct validity. The adequacy of its theoretical structure with regards to the items related to the Commitment and Efficacy facets was estimated with the “Robust maximum likelihood method” (chosen because of the ordinal data). The assessment of the model fit with pretest data (step 5) was completed with the convention used by Shea et al. (2014) for interpreting factor loadings (> 0.60), as well as with four adjustment measures (two incremental and two absolute fit indexes): (1) the comparative fit index (CFI) (≥ 0.95); (2) the Tucker-Lewis index (TLI) (≥ 0.95); (3) the standardized root mean square residual (SRMR) (< 0.08); and (4) the root mean square error of approximation (RMSEA) (< 0.06), as recommended by Hu & Bentler (1999) . The CFI compared the sample covariance matrix with the null (independence) model, while the TLI allowed for the verification of discrepancies between the chi-squared (χ2) value of the sample model and the null model. The SRMR was calculated to document the difference of the standardized residuals between the French version of the ORIC’s observed covariance matrix and the ORIC’s hypothesized covariance matrix. Finally, the RMSEA allowed for the verification of discrepancies between the French version of the ORIC’s observed covariance matrix and the hypothesized covariance matrix of the original ORIC.
Réceptivité organisationnelle à l’implantation d’un changement (ROIC), the French version of the ORIC
For the first step of Beaton’s process (Forward Translation), 20 differences between translators Forward1 and Forward2 were identified. From the preliminary French version of the ORIC obtained at the end of step 2 (Synthesis of the translation), the back translation of the questionnaire (step 3) allowed for the identification of 25 differences with the original version of the ORIC, including 11 common to both translators. The differences identified during steps 1 and 3 raised questions about equivalence regarding semantic structure (e.g., translation of the expression “manage the politics”) and technical (e.g., translation of the gerund “implementing”) aspects of certain items (see Table 1).
Using the English and French versions of the questionnaire, step 4 (Expert committee review) allowed the research team to discuss each translation difference, item per item, in terms of equivalence. Consensus was achieved for all 10 items following a 90-min meeting with the committee of experts. For the 20 translation differences noted in steps 1 and 3 of the process, an agreement was reached, including for the title wording of the French version of the ORIC. Because the translation differences noted for items 3, 4 and 5 were common to those previously discussed for the other items, these statements were not discussed in detail during the meeting. To this end, the verb “mettre en oeuvre” (as opposed to “implanter”) was adopted to standardize the formulation across items.
Finally, the specifications obtained from the ORIC’s authors throughout the cross-cultural adaptation process for step 6 (Submission and appraisal of reports by committee) allowed the team to conduct an in-depth analysis of the differences found between the versions created during steps 1 and 3, and to reach a consensus during the meeting with the expert review committee (step 4). Following the pretest of the French pre-final version of the ORIC (step 5), the specification “[…] de pratique clinique” was added at the end of each item to better contextualize the questionnaire for the solicited population (i.e., occupational therapists). However, to maintain the applicability of the ROIC throughout a diversity of professional contexts, this specification was not kept in the final version. In parallel with the pretest of the French pre-final version of the ORIC (step 5), exchanges with the ORIC’s authors at step 6 allowed for the clarification of the wording of two terms: people (items 1–10) and politics (item 10). For instance, the ORIC’s authors specified that the term “politics” refers to the struggles (e.g., activities that aim at improving someone’s status or position) over power between members of the organization during the implementation of a change.
This allowed the final French 10-item version of the ROIC to define the Commitment (items 1–5) and Efficacy (items 6–10) subscales (see Additional file 1).
Psychometric properties of the ROIC
Of the 886 occupational therapists working in homecare services, 787 occupational therapists who had agreed to be solicited for research purposes were contacted by e-mail to request their participation in the documentation of the psychometric properties of the ROIC. Among the 470 occupational therapists reached, 125 completed the final version (participation rate: 16%). The sample, comprised of 118 women (94%), was representative of Quebec occupational therapists’ gender distribution (92%; p > 0.05) as reported by the professional regulatory board (2015–2016). Participants had been working as occupational therapists for 15.3 years [0.5–36] on average, and in Quebec homecare services (public funded health system) for 9.9 years [0.5–29] on average. Respondent distribution across the province was statistically different (p < 0.05) from that identified by the occupational therapists’ professional regulatory board at the end of the survey period. This difference mainly arose from the absence of respondents in the “Mauricie-et-Centre-du-Québec” administrative region (see Table 2).
Internal consistency of the ROIC’s items
The Cronbach alpha values for the ROIC items demonstrated satisfactory internal consistency for both item subscales, with α = 0.84 for the Commitment subscale and α = 0.86 for the Efficacy subscale, as well as for the overall questionnaire (α = 0.91) . The inter-item correlation coefficients of the French version of the ORIC ranged from 0.32 to 0.73, except for the correlation between items 3 and 9 (r = 0.21; see Table 3). When divided into their respective subscales, the inter-item correlation coefficients of the Commitment and Efficacy subscales ranged from 0.32 to 0.73 and from 0.45 to 0.64 respectively. When grouped by subscale, the item-to-total scale correlation coefficients varied from 0.53 to 0.76 for the Commitment subscale, and from 0.63 to 0.72 for the Efficacy subscale. Specifically, item 1 tended to explain a lower proportion of variance (0.34) than the other items of the Commitment subscale. The Cronbach’s alpha coefficients of the Commitment and Efficacy subscales ranged from 0.78 to 0.84 and from 0.82 to 0.84 respectively (see Table 4). When grouped together (i.e., item-to-total scale statistics of the 10-item version of the ROIC), the corrected correlation coefficients ranged from 0.62 to 0.78, except for items 3 (r = 0.54) and 9 (r = 0.58). Variation in Cronbach’s alpha coefficients removed oscillated between 0.89 and 0.91 (see Table 5).
Construct validity of the ROIC’s items
The confirmatory factor analysis with the ROIC’s results suggested a moderate fit of the French version with the theoretical structure of the ORIC (see Table 6). Four items (2 to 5) intended to document the Commitment subscale exhibited factor loadings superior to 0.60, and all five items related to the Efficacy subscale reached this threshold. The CFI was equal to 0.89 and the TLI to 0.85, whereas SRMR and RMSEA coefficients reached 0.08 and 0.12 respectively.
The purpose of this study was to conduct a French cross-cultural adaptation of the ORIC, a questionnaire which aims to document the organizational readiness of members to implement change within an organization. This cross-cultural adaptation process has resulted in a new French version of the ORIC, the ROIC. Preliminary psychometric testing suggests that the ROIC has the potential to contribute to the measurement of the construct of organizational readiness in the context of health services by documenting the perceptions of members in an organization about a KT process.
In the French scientific literature, although the importance of readiness among individuals of an organization is also recognized as a prerequisite to implementing change , concepts that address organizational readiness are defined differently (see for instance [34, 35]). It is therefore important to situate the construct of organizational readiness in KT studies according to the conceptualization used to illustrate the process. In this study, we mainly used the ROIC to document the perceptions of healthcare professionals about their working environment in homecare services, with regards to the component Recipients (i.e., individuals involved in the KT process) of the i-PARIHS operational model . However, the questionnaire could also inform different levels of context (e.g., local, organizational, external), as suggested in the conceptual frameworks Promoting Action on Research Implementation in Health Sciences  and Consolidated Framework for Implementation Research . To this end, with the use of the ORIC, Sharma et al. (2018) demonstrated that readiness levels varied according to the contextual level studied, which supports the conceptualization of organizational readiness as a multilevel construct .
Regarding the reliability of the ROIC, when the items were divided into their respective subscales, Cronbach’s alpha values (Commitment subscale: α = 0.84 and Efficacy subscale: α = 0.86) were slightly inferior to the coefficients obtained by Shea et al. (2014) in the English original version (Commitment subscale: α = 0.92 and Efficacy subscale: α = 0.88), but remained in the accepted range of homogeneity according to DeVellis (2003) . In this study, the average inter-item correlation coefficients (0.50) and the range of inter-item correlation coefficients [0.21–0.73] were also acceptable (i.e., between 0.15 and 0.50).These results provide initial evidence that the ROIC’s items are related to each other and can be used to document the construct of organizational readiness. However, the high values of inter-item correlation coefficients (> 0.50) observed for items 5, 6 and 7 suggest possible redundancy of content. Considering that items 6 and 7 are related to the Efficacy subscale, the assumption that the content of these items could be in line with items 6 to 10 is plausible since it refers to the same subscale (see Table 3). Concerning the item-to-total scale correlations, Cronbach’s alpha coefficients (Commitment subscale: 0.78 to 0.84; Efficacy subscale: 0.82 to 0.84) were lower than the global internal consistency calculated for each subscale (i.e., Commitment subscale: α = 0.84; Efficacy subscale: α = 0.86). This highlights the importance of each item’s contribution in documenting the subscale to which they refer. While the two facets of the concept of organizational readiness are considered independent, they were still interrelated [5, 14]. This theoretical perspective about the overlap of concepts through the two subscales of the ROIC can also be illustrated with the item-to-total scale statistics of the 10-item version, with Cronbach’s alpha coefficients slightly varying between 0.89 and 0.91, which denotes the tool’s stable internal consistency.
Initial documentation of the ROIC’s model fit using confirmatory factor analysis suggests that the French version of the ORIC’s items can distinguish the two initial subscales of the ORIC’s original version, and provides initial evidence for the ROIC’s construct validity. However, this statement should be nuanced for certain items of the French version of the questionnaire and illustrates the challenge of operationalizing the initial conceptualization of organizational readiness’ components view theoretically as independent factors. Indeed, the factor loading of item 1 is slightly inferior to 0.60 - lower than that obtained in Shea et al.’s initial confirmatory factor analysis . This observation can be triangulated with the lower squared multiple correlation noted for item 1, as it tends to explain a lower proportion of variance than the other items of the Commitment subscale (see Table 4). Although they are near the threshold initially established, the factor loadings of items 2, 3 and 9 are also lower than the ones obtained in the original version of the ORIC (see Table 6). Moreover, the values of the CFI (0.89) and the TLI (0.85) are slightly inferior to the pre-established threshold (≥ 0.95), and the value of the RMSEA (0.12) is slightly superior to the allowed error value (< 0.06) according to Hu & Bentler (1999) . Although the sample size (n = 125) of this study could be considered sufficient according to the rule of thumb using the number of variables (N/p [number of variables] ≥ 10), it does not meet the two other rules usually used in confirmatory factor analysis (i.e., number of parameters [N/q ≥ 5] and sample size [n ≥ 200]) [39, 40]. While the CFI and TLI indexes are less sensitive to sample size than SRMR and RMSEA indexes, the TLI and RMSEA indexes tend to reject the true population model when the sample size is small [32, 41, 42]. Even though these adjustment measures are useful to indicate that equivalence between the ROIC’s and the ORIC’s models may not yet be satisfactory according to some items and the sample size, their original theory-testing purpose should be emphasized. In this perspective, results from the ROIC’s confirmatory factor analysis could also suggest that linguistic validation allowed for selecting the optimal French terms corresponding partly to the original item’s underlying concepts. Storkholm et al. (2018) experienced similar issues with vocabulary (e.g., signification of the term “investment”) when translating and testing the ORIC into a Danish version, and they elected to use an 11-item version presenting the optimal fit . Seeing as several conceptual differences were identified during the cross-cultural adaptation process (see Table 1), it may be that the cultural equivalence between French and English concepts in the field of organizational change, as they appear in the ORIC, is imperfect. For instance, item 1, which shows a relatively weak association with its subscale (Commitment), includes the notion of “being committed”, which can be translated into either “s’engager” or “s’investir” depending on the context.
This study has some limitations. First, contrary to the recommendations of Beaton et al. (2000) concerning the translators’ different backgrounds with regards to the field covered by the questionnaire (i.e., soliciting an expert translator and a “naive” translator), translators Forward1 and Forward2 (step 1) were both “naive” to the field of the ORIC. Moreover, the pretest of the cross-cultural adaptation process completed at step 5 by occupational therapists was not followed by interviews with each respondent to document their perspective on the meaning of each item. However, the pre-final version of the ROIC was tested with 9 participants (i.e., 2 homecare managers and 7 occupational therapists) using the “think aloud technique”, and respondents (2 out of 125) who had some difficulties with items of the ROIC had the opportunity to clarify their uncertainties in a “Comments” area. Secondly, given that the professional regulatory board organization does not allow for a reminder e-mail to participants who previously complete the questionnaire, the test-retest reliability could not be calculated in this study. As the occupational therapists only completed the ROIC (and not the English version of the ORIC), a French validation of the new version was not done as a last step in the cross-cultural process. Thirdly, contrary to the recommendations of Vallerand (1989), the translators who participated in steps 1 and 3 of this cross-cultural adaptation process, as well as the author of the original version of the questionnaire, did not participate in the expert review (step 4) because of availability issues. However, in order to minimize researcher bias (e.g., risk of misunderstanding the terms of the original version as used by the authors), their comments collected throughout the process were carefully considered and used for step 4. Finally, the participants’ sociodemographic characteristics were compared with Quebec’s population of occupational therapists in general, because data pertaining to the population of occupational therapists specifically working within homecare services was unavailable (step 5). However, seeing as occupational therapists from distinct administrative regions of Quebec do not have considerable linguistic cultural differences, these characteristics should not have significant implications for the cross-cultural adaptation process conducted.
The first strength of the study is that it complies with the protocol described by Beaton et al. (2000). The use of Massoubre’s taxonomy to document different types of equivalence also helped perform an in-depth analysis of the variations in the terms chosen during the meeting with the expert committee (step 4). Finally, the absence of missing data despite a considerable sample size (125 respondents) for step 5 (Pretest) also allowed to conduct a rigorous analysis of the French version of the ORIC.
Future studies will be needed to conduct additional psychometric analyses of the ROIC, to document other aspects of its reliability (e.g., test-retest) and to further assess its construct validity (e.g., concurrent and divergent validity with other well-recognized tools in French literature). With regards to the values of the adjustment measures for the current version of the ROIC, further translation revisions with the 10-item version as well as confirmatory factor analyses with a pretested 12-item version might help elaborate different models and find the optimal fit with Weiner’ conceptualization of organizational readiness, as per the original version. To this end, it would be particularly relevant to test the ability of the ROIC to predict the issue of an organizational change following its implementation. In a broader contextual perspective, the evaluation of the ROIC’s usefulness for professionals from various disciplines (e.g., economy) and organizations could also be relevant to expand the scope and relevance of measuring organizational readiness throughout the implementation of a change.
In a context where the importance of theory-based KT measures is increasingly being advocated for the development and validation of tools with known measurement properties, it is essential to put effort into making existing questionnaires available to researchers and clinicians involved in the planning and implementation of a change . The ORIC, now culturally adapted to the French language (i.e., the ROIC), has the potential to support organizations in documenting their member’s readiness for the development of individual- and context-specific interventions. Considering the intra-organizational and dynamic nature of the concept of organizational readiness [44, 45], the use of questionnaires such as the ROIC should be contextualized to give a relevant and authentic picture of the organization and orientate its members in the identification of subsequent efforts for implementing a change.
Availability of data and materials
The dataset used and analyzed specifically for the descriptive statistics related to the pretest (step 5) is part of a larger study on the knowledge translation process of Algo and is available from the corresponding author upon request. The conclusions of this article related to the cross-cultural adaptation process of the ORIC have been disseminated through an oral presentation at the 84th congress of the Association francophone pour le savoir (ACFAS) and a poster presentation at the symposium of the Société québécoise de psychologie du travail et des organisations (SQPTO) in 2016.
Comparative fit index
- i-PARIHS :
integrated-Promoting Action on Research Implementation in Health Services
Organizational Readiness for Implementing Change
Root mean square error of approximation
- ROIC :
Réceptivité organisationnelle à l’implantation d’un changement
Standardized root mean square residual
Cummings GG, Hutchinson AM, Scott SD, Norton PG, Estabrooks CA. The relationship between characteristics of context and research utilization in a pediatric setting. BMC Health Serv Res. 2010;10:168.
Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.
Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–58.
Gagnon MP, Attieh R, Ghandour eK, Légaré F, Ouimet M, Estabrooks C, et al. A systematic review of instruments to assess organizational readiness for knowledge translation in health care. PLoS One. 2014;9(12):e114338.
Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;9:7.
Attieh R, Gagnon M-P, Estabrooks CA, Légaré F, Ouimet M, Roch G, et al. Organizational readiness for knowledge translation in chronic care : a review of theoretical components. Implement Sci. 2013;8:138.
Carlfjord S, Andersson A, Nilsen P, Bendtsen P, Lindberg M. The importance of organizational climate and implementation strategy at the introduction of a new working tool in primary health care. J Eval Clin Pract. 2010;16(6):1326–32.
Kelly P, Hegarty J, Barry J, Dyer KR, Horgan A. A systematic review of the relation between staff perceptions of organizational readiness to change and the process of innovation adoption in substance misuse treatment programs. J Subst Abus Treat. 2017;80:6–25.
Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436.
Armenakis AA, Harris SG, Mossholder KW. Creating readiness for organizational change. Hum Relat. 1993;46(6):681–703.
Harvey G, Kitson A. Implementing evidence-based practice in healthcare: a facilitation guide. New York: Routledge; 2015.
Williams B, Perillo S, Brown T. What are the factors of organisational culture in health care settings that act as barriers to the implementation of evidence-based practice? A scoping review. Nurse Educ Today. 2015;35:e34–41.
Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.
Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4:67.
Contandriopoulos D, Lemire M, Denis JL, Tremblay E. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q. 2010;88(4):444–83.
van Eerd D, Cole D, Keown K, Irvin E, Kramer D, Brenneman Gibson J, et al. Report on knowledge transfer and exchange practices: a systematic review of the quality and types of instruments used to assess KTE implementation and impact. Toronto: Institut for Work & Health; 2011.
Williams I. Organizational readiness for innovation in health care: some lessons from the recent literature. Health Serv Manag Res. 2011;24:213–8.
Belkhodja O, Amara N, Landry R, Ouimet M. The extent and organizational determinants of research utilization in Canadian health services organizations. Sci Commun. 2007;28(3):377–417.
Holt DT, Armenaki AA, Harris SG, Field HS. Toward a comprehensive definition of readiness for change: a review of research and instrumentation. Res Organ Chang Dev. 2007;16:289–336.
Becker WC, Mattocks KM, Frank JW, Bair MJ, Jankowski RL, Kerns RD, et al. Mixed methods formative evaluation of a collaborative care program to decrease risky opioid prescribing and increase non-pharmacologic approaches to pain management. Addict Behav. 2018;86:138–45.
Cunha-Cruz J, Milgrom P, Huebner CE, Scott J, Ludwig S, Dysert J, et al. Care delivery and compensation system changes: a case study of organizational readiness within a large dental care practice organization in the United States. BMC Oral Health. 2017;17:157.
Sanders KA, Wolcott MD, McLaughlin JE, D’Ostroph A, Shea CM, Pinelli NR. Organizational readiness for change: preceptor perceptions regarding early immersion of student pharmacists in health-system practice. Res Soc Adm Pharm. 2017;13(5):1028–35.
Guay M, Dubois M-F, Robitaille J, Desrosiers J. Development of Algo, a clinical algorithm for non-occupational therapists selecting bathing equipment. Can J Occup Ther. 2014;81(4):237–46.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.
Vallerand R. Vers une méthodologie de validation trans-culturelle de questionnaires psychologiques: implications pour la recherche en langue française. Can Psychol. 1989;30(4):662–80.
Massoubre C, Lang F, Jaeger B, Jullien M, Pellet J. The translation of questionnaires and of tests: techniques and problems. Can J Psychiatr. 2002;47(1):61–7.
Arocha JF, Patel VL. Methods in the study of clinical reasoning. In: Higgs J, Jones MA, Loftus S, Christensen N, editors. Clinical reasoning in the health profession. 3e ed. Philadelphia: Elsevier; 2008. p. 193–203.
Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA project approach. J Clin Epidemiol. 1998;51(11):945–52.
DeVellis RF. Scale development: theory and applications. 2 ed. Thousand Oaks: Sage Publications; 2003.
Haccoun RR. Une nouvelle technique de vérification de l'équivalence de mesures psychologiques traduites. Revue québécoise de psychologie. 1987;8(3):30–9.
Cohen RJ, Swerdlik ME. Psychological testing and assessment: an introduction to tests and measurement. 6 ed. New York: McGraw-Hill; 2005.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
Collerette P, Lauzier M, Schneider R. Le pilotage du changement, une approche stratégique et pratique. 2e ed. New York: Presses de l'Université du Québec; 2013.
Bareil C. La résistance au changement: synthèse et critique des écrits. Montréal: Centre d'études en transformation des organisations; 2004.
Øvretveit J, Staines A. L’amélioration de la valeur dans les services de santé. Berlin: Springer Science & Business Media; 2011.
Rycroft-Malone J. The PARIHS framework - a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19(4):297–304.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Sharma N, Herrnschmidt J, Claes V, Bachnick S, De Geest S, Simon M. Organizational readiness for implementing change in acute care hospitals: an analysis of a cross-sectional, multicentre study. J Adv Nurs. 2018;74:2798–808.
Myers ND, Ahn S, Jin Y. Sample size and power estimates for a confirmatory factor analytic model in exercise and sport. Res Q Exerc Sport. 2011;82(3):412–23.
Mueller RO. Basic principles of structual equation modeling. 1 ed. New York: Springer; 1996.
Fan X, Thompson B, Wang L. Effects of sample size, estimation method, and model specification on structural equation modeling fit indexes. Struct Equ Model. 1999;6:56–83.
Marsh HW, Balla JR, McDonald RP. Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol Bull. 1988;103:391–410.
Storkholm MH, Mazzocato P, Tessma MK, Savage C. Assessing the reliability and validity of the Danish version of organizational readiness for implementing change (ORIC). Implement Sci. 2018;13:78.
Taxman FS, Henderson C, Young D, Farrell J. The impact of training intervention on organizational readiness to support innovations in juvenile justice offices. Admin Pol Ment Health. 2014;41:177–88.
Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework. Implement Sci. 2009;4:38.
The authors would like to thank Mr. Rejean Prevost for his technical help in the survey design, and Mr. Eric Constantin for his support in the recuitment for the pretest. The authors would also like to thank Mrs. Lise Trottier from the Research Centre on Aging of the CIUSSS de l’Estrie-CHUS and Mrs. Marie-Pierre Garant from the biostatistics service of the Centre de recherche du CHUS for their help in the statistical analyses and finally, all the healthcare managers and occupational therapists who have accepted to take part in the pretest step.
This study was financed in partnership by the Office des personnes handicapées du Québec (OPHQ) and the Réseau provincial de recherche en adaptation-réadaptation (REPAR). The REPAR is financed by the Fonds de recherche du Québec – Santé (FRQS). These research organizations did not participate to any step of the project (i.e., design, collection, analysis and interpretation of data).
The first author received a scholarship from the Faculty of Medicine and Health Sciences of the Université de Sherbrooke and the Centre de recherche médicale de l’Université de Sherbrooke during her MSc studies to do this research work. She is currently granted by the FRQS and the Unité de SOUTIEN – Strategy to Patient-Oriented Research (SPOR) to pursue her PhD studies. The other authors received salary support from the FRQS.
Ethics approval and consent to participate
This research project has been approved by the Research Ethics Committee of the Centre intégré universitaire de santé et de services sociaux de l’Estrie – Centre hospitalier universitaire de Sherbrooke (MP-22-2016-532). Written consent was obtained from each participant prior to data collection, by clicking on the approval button at the end of the introduction, on the first page of the survey.
Consent for publication
The authors declare that they have no competing interests. The authors alone are responsible for the content and writing of the paper.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Table S1“Organizational Readiness for Implementing Change” French version: Réceptivité organisationnelle à l’implantation d’un changement (DOCX 15 kb)