This article has Open Peer Review reports available.
Translating and testing the Alberta context tool for use among nurses in Swedish elder care
© Eldh et al; licensee BioMed Central Ltd. 2013
Received: 24 September 2012
Accepted: 13 February 2013
Published: 19 February 2013
There is emerging evidence that context is important for successful transfer of research knowledge into health care practice. The Alberta Context Tool (ACT) is a Canadian developed research-based instrument that assesses 10 modifiable concepts of organizational context considered important for health care professionals’ use of evidence. Swedish and Canadian health care have similarities in terms of organisational and professional aspects, suggesting that the ACT could be used for measuring context in Sweden. This paper reports on the translation of the ACT to Swedish and a testing of preliminary aspects of its validity, acceptability and reliability in Swedish elder care.
The ACT was translated into Swedish and back-translated into English before being pilot tested in ten elder care facilities for response processes validity, acceptability and reliability (Cronbach’s alpha). Subsequently, further modification was performed.
In the pilot test, the nurses found the questions easy to respond to (52%) and relevant (65%), yet the questions’ clarity were mainly considered ‘neither clear nor unclear’ (52%). Missing data varied between 0 (0%) and 19 (12%) per item, the most common being 1 missing case per item (15 items). Internal consistency (Cronbach’s Alpha > .70) was reached for 5 out of 8 contextual concepts. Translation and back translation identified 21 linguistic- and semantic related issues and 3 context related deviations, resolved by developers and translators.
Modifying an instrument is a detailed process, requiring time and consideration of the linguistic and semantic aspects of the instrument, and understanding of the context where the instrument was developed and where it is to be applied. A team, including the instrument’s developers, translators, and researchers is necessary to ensure a valid translation. This study suggests preliminary validity, reliability and acceptability evidence for the ACT when used with nurses in Swedish elder care.
KeywordsQuestionnaire Translation Validity Health care context Research utilization Nursing
In recent decades, understanding of what influences implementation of evidence based knowledge in health care has increased. Among other influences, contextual factors are important . Organizational context includes both observable aspects, such as the physical environment and availability of information resources, and underlying aspects, such as social interactions and management . To better understand what hinders and facilitates knowledge transfer, context needs to be assessed . Apart from more generic instruments on employees’ experience of work context (such as; Situational Outlook Questionnaire (SOQ) , Quality-Work-Competence (QWC) , and The revised Nursing Work Index (NWI) ) there are few instruments available particularly for measuring context in relation to knowledge transfer in health care settings. When this study was initiated we recognised three instruments designated for this specific purpose: the Context Assessment Index (CAI) , the Organizational readiness to Change Assessment (ORCA) , and the Alberta Context Tool (ACT) . At that time point, CAI was being tested in Sweden, resulting in a proposed need for further refinement , while ORCA and ACT had not previously been tested in Sweden. The ACT appeared to have promising properties for use in Swedish health care settings, considering similarities in health care organisation and professional practice in Canada and Sweden. Further, the ACT was being considered for a international study on implementation of evidence in elder care, involving both Sweden and Canada .
The Alberta Context Tool was designed to measure modifiable aspects of organizational context in health care settings. It is administered to individuals (i.e., health care staff) to elicit their perceptions of context at the care unit and/or facility level, depending on the context of care delivery. For nurses, this level is frequently the patient or resident care unit. The ACT was developed by Estabrooks and colleagues in Canada and consists of a series of items representing 10 modifiable contextual concepts: (1) leadership, (2) culture, (3) evaluation, (4) social capital, (5) structural and electronic resources, (6) formal interactions, (7) informal interactions, (8) organizational slack – staffing, (9) organizational slack – space, and (10) organizational slack – time .
The theoretical framing for the ACT was the Promoting Action on Research Implementation in Health Services (PARIHS) framework , and related literature in the fields of organizational science, research implementation, and knowledge translation [11–13]. The ACT exists in 3 versions (acute care, long-term care and home care), each with multiple forms for different target groups (health care assistants/aides (HCA); nurses, i.e., licensed practical nurses (LPN) and registered nurses (RN); allied health professionals; physicians; practice specialists (e.g. educators), and care managers). Further, the ACT is accompanied by a set of demographic questions regarding sex, age, education, professional experience and working hours. Scores obtained using the ACT with nurses and HCA’s in paediatric care and residential long-term care facilities respectively, have demonstrated acceptability, reliability, and construct validity [14, 15]. Further, the ACT has been applied in studies on knowledge transfer in health care in Canada and Australia [16–19].
Swedish and Canadian health care have similarities with regards to a variety of aspects, such as political governance and health care financing , health care policies and legislation, and health care professionals’ education and staff perceptions, e.g., with regards to the concept of research utilization among nurses . As a result, the need for an instrument to measure organizational context in knowledge transfer research in Sweden prompted a decision to translate ACT to Swedish, rather than constructing a new instrument. Also, with the similarities between the countries, the possibility for cross-country comparisons was of interest.
Translation of an instrument should consider linguistic, semantic and contextual aspects, aiming to create a valid instrument for the new setting . These aspects refer to a) words and grammar (linguistics), b) concepts (semantics), and c) the context where the instrument was developed and shall be applied, respectively. The linguistic and semantic aspects require consideration of language; For example, according to Ogden and Richard’s  theory on language meaning, there is an indirect relation between a term and a phenomenon by the use of a thought or idea, presented as a concept. When sharing words, as in speaking, listening or reading, the reference to the phenomenon needs to be common for the utterer and the receiver, provided by the shared idea (the concept) linking the word to the phenomenon. Thus, when translating words, we need to make sure not only that we use equal terms but also that we have a common idea of the phenomenon, manifested by the concept. In order for a valid process and outcome, back translation and inclusion of experts and the original instrument developers in the process are important , to manage potential semantic and contextual issues. Since all three aspects need to be considered, i.e. linguistic, semantic and contextual, translation of an instrument signifies a complex and demanding undertaking . This paper reports on the translation of the ACT to Swedish, including linguistic, semantic and contextual aspects, and a testing of preliminary aspects of its validity as well as acceptability and reliability in elder care.
Translation and pilot testing of the ACT, including assessment for validity (in terms of response processes), acceptability, and reliability , using both quantitative and qualitative methods.
Phase 1 - initial translation and back translation
Translation of ACT (long-term care – nurse) from Canadian English to Swedish was performed by two Swedish researchers fluent in English. A back-translation was performed by a professional language reviewer, fluent in both languages. Subsequently, two LPNs and two RNs working in one Swedish elder care facility examined the translated questionnaire to see if it made sense and to complete the tool. The researcher met with them at their workplace, where they individually responded to the questionnaire and provided immediate feedback on any questions or obstacles that they perceived while responding to the questions.
Phase 2 - pilot test
The ACT was pilot tested in 10 Swedish elder care facilities, for response processes validity, acceptability, and reliability. Concurrently to the Swedish pilot test, a modified version of the ACT for long-term care nurses was developed and tested in Canada (in English) and presented to the Swedish research team .
Phase 3 - translation and back translation of the modified ACT
The modified version of the ACT was translated, incorporating the experiences and findings from the initial translation and back translation, and the pilot test. Further, the modified ACT was back translated from Swedish to English by a professional language reviewer. The reliability findings (Cronbach’s Alpha) of the pilot test were reanalysed according to the item structure presented in the modified ACT. In addition, the Swedish researchers performed linguistic, semantic, and contextual analysis on the modified translated ACT. Consensus discussions between the Canadian developers and the Swedish researchers also occurred and continued until both parties reached full consensus in all aspects of the translation.
The Alberta context tool
The long-term care nurse version of the ACT was developed to assess professional nurses’ (RNs and LPNs) perceptions of context. In Sweden, long-term care is referred to as residential care for the elderly (i.e., elder care), including facilities corresponding to nursing homes.
The initial version of ACT applied in Phases 1 and 2 of this study comprised 59 statements, organized in 10 contextual concepts. Each statement was scored on a 5 point Likert (strongly disagree to strongly agree) or frequency (never to almost always, with a not available option where appropriate) response scale. For Phase 3, the ACT for long-term care was modified by the Canadian developers. Changes included three items being transferred between concepts, renaming of contextual concepts, additional guidance on how to respond to items, and layout changes to guide respondents to the appropriate follow-up items . Wording of items and scale responses between this version (Phase 3) and that used in the pilot test (Phase 2) were the same with the following minor exceptions: (1) two changes of words to clarify that the questions respectively were considering the respondent’s work unit, (2) one alteration of order of words and (3) one additional phrase to clarify a profession (i.e. ‘health care aides or health care assistants’).
Setting and sample
The pilot test was conducted in two Swedish municipalities chosen by convenience in order to include about 300 respondents working in elder care. The municipalities were representative of other areas in Sweden, thus including both urban and rural areas, and included 10 residential elder care facilities. The pilot study was performed with nurses, including RNs and LPNs.
Pilot test population, respondents and demographics
Years in profession
Years in working place
Licensed practical nurses
Pilot test procedure
The managers provided verbal and written information to the nurses on their units about the study, and distributed the ACT questionnaires along with envelopes with prepaid postage for return of their responses. Reminders were distributed twice via the managers: two weeks and one week prior to the last day for responding.
Three questions to assess the respondents’ experience of completing the ACT (i.e., response processes validity) were added to the questionnaire, following the ACT items. Response processes validity refers to empirical evidence of the fit between the concept under study (dimensions of context) and the responses given by respondents on the item(s) developed to measure the concept . Response processes validity evidence can come in a variety of forms but is most often derived from observations or interviews employed to determine if an individual’s behavior or verbal explanation(s) are congruent with their responses to an instrument item/question . The three questions addressed: 1) ease in responding to the ACT items, 2) relevance of the ACT items, and 3) clarity of the ACT items. Each question was phrased as a statement, scored by means of a 5-point Likert scale: ‘Strongly disagree’ to ‘Strongly agree’. Space for additional free text comments was also provided.
Phase 1 - translation and back-translation
The Phase 1 translation and back-translation was analysed for linguistic, semantic and contextual equivalence between the Swedish translation and the original ACT by both the Swedish researchers and the Canadian developers . The assessment for linguistics and semantics was done using a scoring of each item as either ‘Equal wording or slight differences but conceptually OK’ or ‘Deviation in wording, potentially changed meaning conceptually’, with additional comments in free text capturing contextual (country) issues.
Phase 2 - pilot test
In Phase 2, response processes validity was assessed by examining respondents’: (1) responses to the three questions added to the questionnaire on ease in responding, relevance, and clarity of the ACT, and (2) additional comments. Responses to the three added questions were analyzed with descriptive statistics using Statistical Package for the Social Sciences (SPSS 19). The additional comments in free text were transcribed verbatim and analyzed using content analysis ; meaning units were condensed and categorized based on what the text said, i.e., the manifest content. Further, acceptability was examined by missing data frequencies and reliability was examined using internal consistency (Cronbach’s Alpha) coefficients. Coefficients can range from 0 to 1; a coefficient of 0.70 is considered acceptable for newly developed scales while 0.80 or higher is preferred, indicating that the items may be used interchangeably .
Phase 3 - translation and back translation of the modified ACT
In Phase 3, the modified ACT was translated including the experiences from the phase 1 translation and back translation and the phase 2 pilot test. Again, the modified ACT was back translated, followed by analyses of the translation and back-translation by the Swedish researchers and the Canadian developers, respectively. Discussion continued until agreement was reached, requiring the translation to include the most accurate phrasing in Swedish to correspond to the Canadian original text and its meaning. This required use of Swedish terminology and grammar that are appropriate in terms of everyday language in Swedish elder care.
Permission to translate and use the ACT was obtained from its developer and copyright holder (Estabrooks). Ethical approval for the pilot test was obtained from the Dalarna University Research Ethics Committee, Sweden. Operational approval was obtained from managers of the care units for elderly involved in the pilot study. The nurses who participated in the pilot study were informed in writing about the voluntary nature of participation and that decision to participate would not impact on their working conditions. A returned questionnaire implied consent.
Nurses’ answers regarding response processes
Agree, n (%)
Neither agree nor disagree, n (%)
Disagree, n (%)
Total, n (%)
Questions easy to respond to
RNs 7 (30)
RNs 13 (57)
RNs 3 (13)
LPNs 72 (56)
LPNs 45 (35)
LPNs 11 (9)
RNs 14 (58)
RNs 9 (38)
RNs 1 (4)
LPNs 80 (67)
LPNs 39 (32)
LPNs 1 (<1)
RNs 9 (38)
RNs 7 (29)
RNs 8 (33)
LPNs 46 (38)
LPNs 68 (57)
LPNs 6 (5)
Additional comments were provided by 21% of the respondents (19 LPNs and 15 RNs), accounting for 20 and 21 comments respectively. The LPNs’ comments primarily referred to the ACT items being complicated and hard to understand (n = 8), including unfamiliar words (n = 3). RN comments mainly concerned the ambiguity of concepts, such as: working group, care team and work place (n = 4), and of response scales (n = 4), while 6 RNs commented on altogether 9 items they considered unclear and why this was the case. Unclarity of the items is exemplified by the following quotes.
‘What is meant by productivity (in the item ‘My organization effectively balances best practice and productivity’)?’ (Italics as in ACT).
‘Individuals, who are they?’ (Re the item ‘Individuals who participate in group activities are valued by others in the group’).
Both LPNs and RNs commented that there were items not relevant for the organization (n = 2 and 3, respectively). Further, one LPN perceived that the questionnaire contained too many questions and took too long to respond to and one RN pointed out the difficulty in responding due to limited experience of the particular work place.
Acceptability was assessed using missing data frequencies. Missing data varied between 0 (0%) and 19 (12%) cases (nurses) per item, the most common being 1 missing case per item occurring in15 items. Three ACT items had 10 or more missing cases : (1) attendance at ‘In-services/workshops/courses’ (n = 10 missing cases); (2) attendance at ‘continuing education held outside the elder care facility’ (n = 10 missing cases); and, (3) frequency of ‘residential care related discussions with health care assistants’ (n = 19 missing cases).
Internal consistency for eight contextual concepts of ACT in elder care
ACT- contextual concepts
Pilot study data analysed by the modified ACT
0.87 (n = 149)
No change to contextual concept
0.63 (n = 148)
No change to contextual concepti
0.87 (n = 147)
No change to contextual concept
0.56 (n = 134)
0.73 (n = 153)
0.68 (n = 149)
No change to contextual concept
Structural and electronic resourcesii
0.77 (n = 118)
Organizational slack (staffing, space, time)iii
0.87 (n = 133)
No change to contextual concept
In phase 3, the data from the pilot test was applied for reanalysis to the structure of the modified version of the ACT. Based on psychometric analyses, this meant that two items were moved from the contextual concept ‘Formal interactions’ to ‘Informal interactions’ and one item on attendance of ‘In-services/workshops/courses in your facility’ was moved from the contextual concept ‘Structural and electronic resources’ to ‘Formal interactions’. In our reanalysis of these three concepts, the following Cronbach’s Alpha coefficients were determined: ‘Informal interactions’ (Alpha = 0.63, increase from previous value of 0.56); ‘Formal interactions’ (Alpha = 0.80, increase from previous value of 0.73); and, ‘Structural and electronic resources’ (Alpha = 0.77, unchanged from previous value), see Table 3.
Identified linguistic and semantic issues in the phase 1 translation and back translation of the ACT
Team (Swe for Sweden, Ca for Canada)
Equal wording or slight differences but conceptually OK
Questioned if equal in wording or with slight differences/need for minor change
No of items (%)
During the translation, back translation and consensus process, linguistic and semantic as well as contextual (country-specific) challenges were encountered. Linguistic challenges included English words not existing in Swedish (e.g. ‘champions’ in the sentence ‘Someone who champions research in practice’, substituted by ‘advocates’), words not being common language (e.g. ‘family conferences’, substituted by ‘care planning with family’), and Swedish homonyms (i.e., words with the same pronunciation and spelling but different meaning) and synonyms. The main semantic challenges were to find terms that captured the essence of the ACT concepts in English, yet being expressed in everyday Swedish language. For example, ‘mentors’ in the ACT item ‘actively mentors or coaches performance of others’ may be translated to three possible words in Swedish (equivalent to ‘leads’, ‘supervises’ or ‘guides’). The word was translated as ‘guides’ in Swedish, but ‘guides’ was then back translated to English as ‘leads’, which carries a different meaning from ‘mentors’ in the English language. Other challenges included translating English terms and phrases that do not exist in Swedish. For example, ‘the best day’ in the ACT item ‘we have enough staff to make sure the residents have the best day’ does not have a corresponding expression in Swedish. In the end, this challenge was overcome by using ‘we have enough staff to make sure residents have the best situation achievable’. Finally, contextual (country specific) challenges centred around acknowledging the structure and various functions in Canadian health care, identifying equivalents (or if not possible, nearly equivalents) in Swedish health care. The deviations between countries concerned non-existing roles, and organisation of care including work shift hours, and title of managers. An example was managing the translation of ‘nurse practitioner’, which was a part of an item containing several options (nurse practitioner/clinical instructor /lecturer/specialist nurse). Nurse practitioner is a profession common in Canada which does not exist in Swedish health care. Therefore, this term was excluded, leaving the item with the options ‘clinical instructor /lecturer/specialist nurse’. Further, the analysis recognized one item within the contextual concept ‘Culture’ as being misinterpreted in the translation process; in the pilot study version the item ‘a supportive work group’ had been translated to ‘support work group’, the latter indicating a supervised group rather than ones work team being supportive. When this item was excluded from the pilot test analysis, acceptable homogeneity of the contextual concept Culture was reached (Cronbach’s alpha 0.71, rather than 0.63). Linguistics or semantics did not explain lower internal inconsistency values for other ACT concepts.
Linguistic, semantic and context related deviations in final translation of the ACT
Description of translational issue (Swe for Sweden, Ca for Canada)
Type of issue
Discussion (Swe for Sweden, Ca for Canada)
Swe: Suggest calling the team ‘nursing team’ in Swedish since there are no other teams in long term care
Ca: The survey includes questions about interactions with physicians, therapists, etc.
Ca: ‘with respect to’ not equivalent to ‘starting point’
Raised as semantic, revealed as linguistic
Swe: the word used for ‘starting point’ is equivalent to ‘think of’
Agreed on ‘think of’
Swe: ‘role’ has two meanings, the equivalent of function is the closest
Ca: the item is mainly about ensuring the questionnaire is filled out by the target group for the survey and not another health care provider
Agreed on ‘function’
Ca: Number of shifts and number of hours per shift differs between Ca and Swe
Swe: Standard shifts are morning (7.00 -8.00, finishing 13.00 - 16.00), afternoon (start at 11–15, end at 19–21) and night shift
Agreed to country specific groups
Swe: One word equals manager or head or boss
Ca: Manager needs to be specified as home manager
Ca: ‘Difficult to hear’ needs a better translation
Swe: Suggest equivalent to ‘unpleasant to hear’
Swe: Leave out the word ‘acknowledges’ since no Swedish equivalent works in the context
Ca: This does not impact on meaning
Ca: There is a difference between solving and resolving
Raised as semantic, revealed as linguistic
Swe: There is one word only, meaning solving and resolving
Agreed to use suggested word
Swe: There is no equivalent to ‘best practice’
Ca: Suggested ‘best possible care’ all right
Ca: Having two words separated by a slash makes items double barrelled
Swe: Suggest ‘team’ rather than ‘group’ to equal team and ‘relatives’ to equal family
Ca: Aim for the notion of ‘last’ typical month
Swe: Suggest we use ‘last ordinary’
Ca: ‘attended’ is different from ‘participated’ in English
Raised as semantic, revealed as linguistic
Swe: There is one word meaning both ‘participated’ and ‘attended’
Swe: There is no equivalent to respiratory therapist in Sweden
Ca: OK to exclude
Swe: ‘Bedside teaching’ does not exist in elder care but suggest ‘Informal teaching in direct nursing care situations’
Ca: ‘Routinely’ needs an equivalent
Swe: No exact word works in this context but suggest using ‘generally’
Ca: Does ‘those assigned responsible’ equate to ‘positions of authority’?
Ca: ‘comfortable’ needs an equivalent
Swe: ‘Comfortable’ can be used even if it means applying informal language in the item
Swe: ‘team exchanges’ needs to be specified as ‘information exchange’ to clarify that it’s not just any exchange (e.g., recipes)
Swe: The word for library is better understood if in definite form or to write it in the plural
Ca: Please use definite form
Ca: Please provide equivalent to ‘best day’
Swe: ‘best situation achievable’ is the closest
Ca: Please provide equivalent to ‘private space’
Swe: Suggest using a word indicating both ‘separate’ and ‘private’
Ca: Scale should range from ‘Strongly disagree’ to ‘Strongly agree’
Swe: Suggest we use the standard Likert scale wording applied in Swedish
Swe: If phrasing How often do you…’ in Swedish in this context, it reads ‘How often do you have…’
Swe: Does ‘care of plan for resident’ equal ‘resident’s care plan’?
Ca: Yes it does
Agreed to translate as ‘resident’s care plan’
In the initiation of Phase 1, i.e. the first translation of the ACT for nurses in long term care to Swedish, the translation process felt uncomplicated by the Swedish researchers. Further, the initial responses regarding experiences of responding in a group of four nurses indicated few difficulties in understanding and responding to the instrument. However, after analysis of the Phase 1 translation and back translation, we discovered incongruence between the Canadian original and the Swedish translation that needed attention. This was further supported by the pilot test in Phase 2, where we found that a translation error (in an item in the ACT concept of culture) could explain suboptimal reliability. Further, the translation and back translation of the modified Canadian version of ACT for long term care in Phase 3 identified additional linguistic, semantic and contextual (country) issues. Our experiences emphasize the need for a careful and collaborative approach in cross-cultural translation and testing of instruments .
To us it was important to provide, insofar as it was possible, everyday language in the translation, yet staying true to the original meaning of the items. This required attention to semantics and extensive discussions about the meaning of a concept and exact terms used to denote it . In this study, we accomplished this through continuous dialogue between the translating and testing research team and the original tool developers. An important issue that we encountered is how to handle translation when there are no equivalent terms for a concept in the translated language. For instance, English has a large number of synonyms , compared to Swedish. This is possibly influenced by two factors: First, even though both English and Swedish have their origin in Germanic languages, English was also later influenced by the Romance languages , resulting in the development of a greater diversity of terms (synonyms) in the English language. Second, 326 million people speak English as their first language (compared to the 9.5 million people who speak Swedish as their first language); this too has contributed to a more rapid expansion of the English language . Therefore, in instances where no equivalent Swedish terms were available for an English word or phrase, we sought consensus on whether a verbatim translation was essential. Our response processes data demonstrated that while most Swedish nurses were able to answer ACT items that contained words and phrases that were uncommon in everyday Swedish language, they largely considered them equivocal in clarity (i.e., as ‘neither clear nor unclear’). Thus, in Phase 3, we aimed for the best possible translation, recognizing the barriers of language differences, the conceptual meaning of each word, and differences in Canadian and Swedish elder care contexts.
There are several approaches to instrument translation ; from a forward translation only, through back translation and monolingual test to back translation in addition to mono- and bilingual tests. In this study, we settled for the mid-approach; translation and back translation in addition to testing the translated instrument in a target language sample. Even though the above process is considered both time and cost consuming, the benefit is better semantic equivalence between the source language and target language versions and the ability to test reliability and validity in the target group . By sharing back translations of the initial and the modified Canadian versions of the ACT and by carrying out the subsequent analysis and dialogue, the Swedish researchers and the Canadian instrument developers were able to detect important linguistic and semantic discrepancies. An instrument such as the ACT, with 59 items, requires considerable time for dialogue and correspondence between developers and translators for a valid translation.
The context of long term care in Canada and elder care in Sweden reflects differences that needed consideration in the translation process. In the pilot test, 19 nurses did not respond to the item regarding information exchange with health care assistants (HCA). When analysing the additional comments, one nurse described that there were no HCAs in the organization, providing a possible explanation for the lack of responses to this particular item. Further, the version of ACT used in this study was designated for ‘nurses’; in Canada referring to LPNs and RNs. These two groups of nurses may have similar roles in Canadian long term care, whereas in Swedish elder care the team providing direct nursing care consists of either LPNs and HCAs, or LPNs only. RNs may be a part of the nursing team or they may have a consultant role for the nursing teams on the units, depending on how the nursing care is organized. We found this somewhat mirrored in the response processes data, where LPNs and RNs differed to some extent in how they perceived responding to the ACT, and also pointed out ambiguous words such as working group, care team and work place. Two separate questionnaires have since been developed for Swedish use with LPNs and RNs in elder care respectively, with identical items but unique demographics. This will allow for separate national (Sweden)-level analysis for RNs and LPNs while still allowing for a merged (all nurses) analysis to perform cross-country comparisons where appropriate.
Poor layout  or poor item order  can cause non-responses to particular items. In this study, there was, for example, 6% missing data on the item ‘in-service training’ in the pilot test. The heading for the item was identical to a prior instruction, where respondents were advised to respond only if given particular responses to a further prior item. Thus, respondents may have missed that they should respond to the item ‘in-service training’. As we assumed that the high number of non-responses could be an effect of poor layout in the pilot test ACT version , we compared the pilot test data to that of a later study employing the modified version of ACT in elder care with a similar administration procedure; in the modified version respondents were guided by arrows directing to either the follow up questions and then to the item on in-service training, or straight to ‘in-service training’. With the modified ACT, non responses for the item ‘in-service training’ was <1%. We suggest this signifies the importance of layout and design in constructing questionnaires [38, 39].
Through the translation and testing process described in this paper, we experienced the complexities of instrument translation and discovered the need to: (a) be sensitive to contextual (country) differences and (b) the importance of a thorough and collaborative team approach [22, 28]. This study confirms that translation of an instrument requires adequate time and considerable care during the translation processes. Further, we found that including the instrument developers in the process was important and enhanced our ability to complete a sound translation and robust pilot test process. A meticulous process including translation and back translation and testing the instrument in the country where it will be used provides a deeper understanding of the linguistic, semantic and contextual aspects of the instrument, in both the original and the translated version. Further, a team process serves as a mediator for improved understanding of the context (country) where the instrument was developed and where it is being translated and tested. This, in turn, will contribute to more valid cross-country comparisons of data.
The authors would like to thank Rickard Johansson, R.N., M.Sc., for contributing to the pilot test. CAE holds a Canadian Institutes for Health Research (CIHR) Canada Research Chair in Knowledge Translation. The research leading to these results has received funding from the European Union’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 223646.
- Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004, 13 (8): 913-924. 10.1111/j.1365-2702.2004.01007.x.View ArticlePubMedGoogle Scholar
- Cummings GG, Estabrooks CA, Midodzi WK, Wallin L, Hayduk L: Influence of organizational characteristics and context on research utilization. Nurs Res. 2007, 56 (4): S24-S39.View ArticlePubMedGoogle Scholar
- Isaksen SG: The situational outlook questionnaire: assessing the context for change. Psychol Rep. 2007, 100 (2): 455-466. 10.2466/pr0.100.2.455-466.View ArticlePubMedGoogle Scholar
- Arnetz J, Arnetz B: The development and application of a patient satisfaction measurement system for hospital-wide quality improvement. Int J Qual Health Care. 1996, 8 (6): 555-566. 10.1093/intqhc/8.6.555.View ArticlePubMedGoogle Scholar
- DeSantis L, Ugarriza DN: The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000, 22: 351-372.View ArticlePubMedGoogle Scholar
- McCormack B, McCarthy G, Wright J, Slater P, Coffey A: Development and testing of the Context Assessment Index (CAI). Worldviews Evid Based Nurs. 2009, 6 (1): 27-35. 10.1111/j.1741-6787.2008.00130.x.View ArticlePubMedGoogle Scholar
- Helfrich CD, Li YF, Sharp ND, Sales AE: Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009, 4: 38-10.1186/1748-5908-4-38.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Cummings GG, Birdsell JM, Norton PG: Development and assessment of the Alberta Context Tool. BMC Health Serv Res. 2009, 9: 234-10.1186/1472-6963-9-234.View ArticlePubMedPubMed CentralGoogle Scholar
- Nilsson Kajermo K, Böe H, Johansson E, Henriksen E, McCormack B, Gustavsson J, Wallin L: Swedish translation, adaptation and psychometric evaluation of the context assessment index (CAI). Worldviews Evid Based Nurs. 2013, 10 (1): 41-50. 10.1111/j.1741-6787.2012.00252.x.View ArticlePubMedGoogle Scholar
- Seers K, Cox K, Crichton NJ, Edwards RT, Eldh AC, Estabrooks CA, Harvey G, Hawkes C, Kitson AL, Linck P: Facilitating implementation of research evidence (FIRE): a study protocol. Implement Sci. 2011, 7: 25.View ArticleGoogle Scholar
- Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004, 16 (2): 107-123. 10.1093/intqhc/mzh030.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Grol R, Berwick DM, Wensing M: On the trail of quality and safety in health care. BMJ. 2008, 336 (7635): 74-76. 10.1136/bmj.39413.486944.AD.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Hayduk LA, Cummings GG, Norton PG: Advancing the argument for validity of the Alberta Context Tool with healthcare aides in residential long-term care. BMC Med Res Methodol. 2011, 11: 107-10.1186/1471-2288-11-107.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Hutchinson AM, Scott S, Cummings GG, Kang SH, Midodzi WK, Stevens B: Assessment of variation in the alberta context tool: the contribution of unit level contextual factors and practice specialty in Canadian pediatric acute care settings. BMC Health Serv Res. 2011, 11: 251-10.1186/1472-6963-11-251.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Cummings GG, Teare GF, Norton PG: Study protocol for the translating research in elder care (TREC): building context - an organizational monitoring program in long-term care project (project one). Implement Sci. 2009, 4: 52-10.1186/1748-5908-4-52.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Morgan DG, Squires JE, Boström AM, Slaughter SE, Cummings GG, Norton PG: The care unit in nursing home research: evidence in support of a definition. BMC Med Res Methodol. 2011, 11: 46-10.1186/1471-2288-11-46.View ArticlePubMedPubMed CentralGoogle Scholar
- Schultz TJ, Kitson AL: Measuring the context of care in an Australian acute care hospital: a nurse survey. Implement Sci. 2010, 5: 60-10.1186/1748-5908-5-60.View ArticlePubMedPubMed CentralGoogle Scholar
- Cummings G, Hutchinson A, Scott S, Norton P, Estabrooks C: The relationship between characteristics of context and research utilization in a pediatric setting. BMC Health Serv Res. 2010, 10: 168-10.1186/1472-6963-10-168.View ArticlePubMedPubMed CentralGoogle Scholar
- Olsen GM: The politics of the welfare state: Canada, Sweden, and the United States. 2002, Toronto: Oxford University PressGoogle Scholar
- Estabrooks CA, Squires JE, Strandberg E, Nilsson-Kajermo K, Scott SD, Profetto-McGrath J, Harley D, Wallin L: Towards better measures of research utilization: a collaborative study in Canada and Sweden. J Adv Nurs. 2011, 67 (8): 1705-1718. 10.1111/j.1365-2648.2011.05610.x.View ArticlePubMedGoogle Scholar
- Yu DS, Lee DT, Woo J: Issues and challenges of instrument translation. West J Nurs Res. 2004, 26 (3): 307-320. 10.1177/0193945903260554.View ArticlePubMedGoogle Scholar
- Ogden CK, Richards IA: The meaning of meaning: A study of the influence of language upon thought and of the science of symbolism. 1989, New York: HarcourtGoogle Scholar
- Harkness J, Schoua-Glusberg A: Questionnaires in translation. ZUMA-Nachrichten Spezial. 1998, Jan: 87-126.Google Scholar
- The American Educational Research Association, The American Psychological Association, and the National Council on Measurement in Education: The Standards for Educational and Psychological Testing. 1999, Washington, D.C: Americanucational Research AssociationGoogle Scholar
- Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to Their Development and Use. 2008, Oxford: Oxford University Press, 4View ArticleGoogle Scholar
- Tourangeau R, Rips L, Rasinski K: The Psychology of the Survey Response. 2000, New York: Cambridge University PressView ArticleGoogle Scholar
- Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005, 8 (2): 94-104. 10.1111/j.1524-4733.2005.04054.x.View ArticlePubMedGoogle Scholar
- Graneheim UH, Lundman B: Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004, 24 (2): 105-112. 10.1016/j.nedt.2003.10.001.View ArticlePubMedGoogle Scholar
- Nunnally J, Bernstein I: Psychometric Theory. 1994, New York: McGraw-HillGoogle Scholar
- Polit DF, Beck CT: Nursing research. 2008, Philadelphia: Lippincott Williams & Wilkins, 8Google Scholar
- Watkins C: The American Heritage Dictionary of Indo-European Roots. 2011, Boston: Houghton Mifflin Harcourt, 3Google Scholar
- Editors of the American Heritage Dictionaries: The American Heritage Dictionary of the English Language. 2006, Boston: Houghton Mifflin Harcourt, 4Google Scholar
- : , Wikipedia. Available at http://en.wikipedia.org/
- Maneesriwongul W, Dixon JK: Instrument translation process: a methods review. J Adv Nurs. 2004, 48 (2): 175-186. 10.1111/j.1365-2648.2004.03185.x.View ArticlePubMedGoogle Scholar
- Redline CD, Dillman DA, Carley-Baxter L, Creecy RH: Factors that influence reading and comprehension of branching instructions in self–administered questionnaires. Allg Stat Arch. 2005, 89 (1): 21-38.Google Scholar
- McFarland SG: Effects of question order on survey responses. Public Opin Q. 1981, 45 (2): 208-215. 10.1086/268651.View ArticleGoogle Scholar
- Dillman DA, Smyth JD, Christian LM: Internet, mail, and mixed-mode surveys: the tailored design method. 2008, Westford, MA: Wiley & SonsGoogle Scholar
- McGibbon G: How to make a questionnaire work. Nurs Times. 1997, 93 (23): 46-48.PubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/68/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.