- Research article
- Open access
- Published:
Validity and reliability of the Chinese version of the Normalization MeAsure Development(NoMAD)
BMC Health Services Research volume 22, Article number: 1338 (2022)
Abstract
Background
The Normalization MeAsure Development (NoMAD) is a brief quantitative tool based on the Normalization Process Theory (NPT), which can measure the implementation process of new technologies and complex interventions. The aim of our study was to translate and culturally adapt the NoMAD into Chinese, and to evaluate the psychometric properties of the Chinese version of NoMAD.
Methods
According to the NoMAD translation guideline, we undertook forward translation, backward translation, and compared these translations to get a satisfactory result, then we performed cognitive interviews to achieve cross-culture adaptation. And the psychometric properties of the final version were evaluated among clinical nurses who used the pressure injuries management system via WeChat mini-program at a tertiary hospital in northwestern China.
Results
A total of 258 nurses were enrolled in our study, and the response rate was 92.1%. The Cronbach’s alpha of four dimensions were as follow: Coherence (0.768), Cognitive Participation (0.904), Collective Action (0.820), and Reflexive Monitoring (0.808). The overall internal consistency was 0.941. The confirmatory factor analysis results showed a good fit for its theoretical structure (CFI = 0.924, TLI = 0.910, RMSEA = 0.0079, SRMSR = 0.046, χ2/df = 2.61). The item-level content validity index ranged from 0.857 to 1, and the scale-level content validity index was 0.95. There were positive correlations between four constructs scores and three general normalization scores.
Conclusions
The Chinese version of NoMAD is a reliable and valid tool to evaluate the implementation process of innovations.
Background
Implementation research can address the challenges of the substantial gap between research evidence and clinical practices, which is increasingly paid attention to by researchers in recent years [1,2,3,4]. In the field of implementation science, Proctor and colleagues proposed eight core implementation outcomes including acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration and sustainability [5]. Sustainability emphasizes the routinization and institutionalization of innovations. Based upon results from a recent systematic review of the implementation outcome instruments [6], there are only two instruments to assess sustainability, one is designed for long-term care [7], of which reliability and validity were poor, and the other one is the Normalization MeAsure Development (NoMAD).
NoMAD is a simple quantitative tool to evaluate factors that promote or inhibit implementation success from the perspective of participants [8], which has been adapted into Swedish [9], Dutch [10] and Brazilian Portuguese [11]. The original NoMAD instrument has been applied to a diverse range of interventions, such as a health literacy training program [12], a shared decision-making conversation tool [13], telehealth [14], surgical safety checklist [15], pharmacy workforce [16], a dietitian-led model of care [17], weight management program [18], a novel oral health risk assessment tool [19] and the primary care services for transgender individuals [20]. It was developed by Finch et.al in 2018, through item development, item testing and developing indicators [21, 22]. NoMAD was derived from the Normalization Process Theory (NPT) which aims at describing and explaining the implementation, embedding, integration of organizational innovations and complex interventions into clinical routine [23, 24].
Introduction of pressure injuries management system
Pressure injury (PI) is defined as “localized damage to the skin and/ or underlying tissue, as a result of pressure or pressure in combination with shear”. PI usually occurs over a bony prominence but may also be related to a medical device or other objects. PI is an indicator of the quality of care and is a common and significant clinical concern among nurses [25,26,27]. The current PI management relies on paper-based medical records or computer-based information system, which is inefficient and time-consuming. Fortunately, with the evolution of information technology, mobile health (mHealth) has been increasingly used in clinical practice [28, 29]. WeChat application is the most popular social media platform in China, with more than one billion active daily users [30]. Mini program is a sub-application embedded in WeChat. There is no need for downloading, installing, registering, or logging in mini-program, which is easy to use and saves space for the smartphone. People can get into a mini-program via scanning a QR-code or social sharing.
The “Longhuhui” PI management system via WeChat mini-program was developed by the nursing department of a 2600-bed tertiary academic teaching hospital in Northwestern China. The PI management system was mainly used for hospitalized patient PI risk assessment (based on the Braden scale), which aimed to replace the traditional paper version of the PI risk assessment form. In addition, for PI high-risk patients, the preventive interventions would be recorded; for patients with PI, the wound assessment and interventions would be recorded. The system was officially put into use in the whole hospital on January 1st, 2021. The WeChat account of each clinical nurse was registered as a real-name account and only certified nurse accounts can log into the PI management system. The PI management of the hospital was a three-level quality management system, and each department was equipped with one or two PI coordinators. The charge nurses assess the PI risk of newly admitted patients; if the patient had PI, it would be reported by the PI coordinators. All risk assessments and wound assessments would be reviewed by the head nurse and then reported to the quality control team of the nursing department.
Aim
The aim of our study was to translate and culturally adapt the NoMAD into Chinese, and to evaluate the psychometric properties of the Chinese version of NoMAD by testing PI management system via WeChat mini-program among Chinese nurses.
Methods
Study design
Our study used a mixed-methods approach to develop and validate the Chinese version of NoMAD (C-NoMAD), following a four-phase process [31]. This process includes translation, cross-cultural adaption, pilot test and psychometric testing.
NoMAD instrument description
The English NoMAD instrument consists of three parts: part A is about participant’s information; part B has three general questions about participant’s experience and acceptability of intervention in three different perspectives, using a 10-point Likert scale, with higher scores indicating better normalization; and part C has 20 items based on NPT four core constructs: Coherence (4 items), Cognitive Participation (4 items), Collective Action (7 items), and Reflexive Monitoring (5 items), this part has two options, option A is a 5-point Likert scale (strongly agree to strongly disagree); option B is the irrelevant reason (not relevant to my role/at this stage/to the intervention). The English version of NoMAD is freely available under creative commons licence for research purposes [32].
Phase 1 translation
According to the NoMAD translation guideline [31], forward translation was conducted by two bilingual speakers (Chinese as the native language) independently, backward translation was conducted by two native English speakers who had not seen the original NoMAD instrument. Then, the researcher team members compared the translations and discussed the appropriate translation draft. The comparability between the translations was often the different expression of synonyms, such as “feel → think, affect → influence, people → personnel, legitimate → legal, be open to → be willing to, adequately → fully, effect → impact”.
Phase 2 cross-cultural adaption
To understand whether the tool developed in the English context can be generalized to the Chinese cultural context and to ensure the equivalence of the tool measurement, we conducted a face-to-face interview using the C-NoMAD translation draft. Through convenience sampling, we selected ten healthcare workers to investigate their understanding and perspective about each C-NoMAD item. The inclusion criteria of participants were frontline clinical staff who had used mHealth or eHealth in clinical work and voluntarily participate in this study.
In an interview, firstly, the researcher explained the purpose and process of the study; secondly, asked the interviewees to sign the interview informed consent form; thirdly, asked them to fill in the C- NoMAD translation draft; then, the researcher interviewed them according to the interview guide, Table 1 shows the list of open-ended questions or prompts. If the interviewees raised questions about the expression of some items, the researcher would explain the meaning of the original items, then the interviewees were asked to provide appropriate expressions according to their own understanding. Interviews took place in an undisturbed room at the hospital and lasted between 45 and 60 min. All interviews were audio-recorded, meanwhile, the researcher took the corresponding notes. Based on the interview results, the expressions of some items were revised and a tentative draft of the C-NoMAD was formed after the discussion of the researcher team. The adjustment was about the subtle expression of Chinese.
Phase 3 pilot test
The inclusion criteria of experts were being specialized in psychometrics or implementation science or evidence-based medicine, having the title of associate professor or above, and having a Master's degree or above education background.
The expert consultation questionnaire consisted of three parts: (1) Letter to experts: introduction about the purpose and content of the study, the background of NPT and NoMAD; (2) Expert basic information form: demographic information of the experts, their familiarity with the research questions, and the basis of their judgment; (3) Expert evaluation form: asking the experts to choose the relevance or representativeness of each item of the NoMAD tool concerning the corresponding content dimension, with options for a four-level rating (1 = not relevant, 2 = relevant, 3 = relatively relevant, 4 = very relevant), as well as comments on modifications to each item and overall suggestions for this study.
Based on the inclusion criteria, the researcher identified seven appropriate experts. For experts in Lanzhou City, the researcher introduced the purpose of this study and relevant background information to the expert in person before issuing a paper version of the expert consultation questionnaire. For experts outside Lanzhou city, the researcher contacted them by e-mail which included the electronic version of the expert consultation questionnaire and the original version of the NoMAD tool.
After collecting expert consultation questionnaires, we summarized and synthesized all experts’ comments on item modifications. Then, according to the experts’ comments, the research team members discussed and modified some items to form the final translation of the Chinese version of the NoMAD instrument.
Phase 4 psychometric testing
The researchers came to clinical departments in person and in each department first invited the head nurse to fill in the paper-based questionnaire, and asked if any items were difficult to understand. If so, the researcher would explain and record the problematic items. After that, the head nurse distributed them to the department nurses to fill in, and the researcher then went to the department at the appointed time to collect the questionnaires. The survey questionnaire consists of three parts: (1) demographic information including age, sex, working years, educational level, position, professional title and working department; (2) the 23-item Chinese version of the NoMAD instrument; (3) two open-ended questions “Is there any item hard to understand? if there is, please write down the item number and its reason.” and “Do you have any suggestion for improving the PI WeChat mini-program implementation?”. The inclusion criteria of participants were clinical nurses who had used the PI WeChat mini-program and volunteered to participate in our study. The exclusion criteria were nurses working less than one year in the clinic, considering they were still in a standardized training period who had not managed the patients independently and were not familiar with the mini-program. To conduct the structural equation model, a minimum of 200 participants were required [33].
Statistical analysis
We used descriptive analysis to summarize participants’ demographic information. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guided our outcome measures [34].
For reliability, we used Cronbach’s alpha coefficient to examine internal consistency. The cut-off value is equal to or greater than 0.70 was considered acceptable [35].
For validity, we tested the C-NoMAD by assessing two aspects: content validity and construct validity. Content validity was calculated by content validity index (CVI), including Item-level CVI (I-CVI) and scale-level CVI (S-CVI) [33]. The value of I-CVI and S-CVI equal to or greater than 0.8 was considered good. We used confirmatory factor analysis (CFA) by the robust Weighted Least Square Means and Variances (WLSMV) estimator to assess construct validity [36]. According to the recommended cutoff criteria, the adequate model fit was defined as the value of Tucker Lewis Index (TLI) and comparative fit index (CFI) are greater than 0.9, respectively [37]; and the value of the root mean square of approximation (RMSEA) and standardized root mean square residual (SRMR) are less than 0.08, respectively [38].
We also calculated bivariate correlations between three general questions scores and four construct and overall scores via Pearson correlation coefficients.
We used IBM SPSS for Windows (Version 25.0 Armonk, NY, USA) and AMOS to perform all statistical analysis.
Ethical considerations
Our study protocol was approved by the ethics committee of nursing school of Lanzhou University (LZUHLXY20190062). Before commencing each face-to-face interview, verbal consent was obtained from all interviewees. Prior to the start of data collection, all participating nurses were informed of the details about the study and signed written informed consent.
Results
Characteristics of study participants
A total of 280 questionnaires were collected in the survey, of which 22 were missing data and answered regularly, so the number of valid questionnaires was 258, and the response rate was 92.1%. The majority of the survey respondents were female (96.9%), senior nurse (60.5%), bachelor’s degree (95.0%). The average ages of the participants were 32.48 ± 6.30 years, ranging from 21 to 57 years, and the average working years were 9.66 ± 7.34 years, ranging from 1 to 36 years. The detailed information sees Table 2.
PI management system implementation results
Figure 1 shows the results of three general questions. Table 3 presents the participants’ responses to each item of Part C. The majority of responses were chosen “agree” or “neutral”. According to the participants’ feedback, the most hard-to-understand item was item #3 “I understand how the [intervention] affects the nature of my own work”.
According to the feedback, no one filled in the first open-ended questions about the problematic items. A total of 49 people had written about the PI management system suggestion. The main comments can be grouped into 3 topics: (1) the proposal on the design of PI management system (26, 53.1%); (2) the standpoints on increasing clinical workload after the PI management system implementation (21,42.9%); (3) the recommendations on conducting more relevant training (2, 4%).
Internal consistency reliability
The overall Cronbach’s alpha coefficients of the C-NoMAD was 0.941, and that of the four dimensions were as follows: Coherence (0.768), Cognitive Participation (0.904), Collective Action (0.820), and Reflexive Monitoring (0.808). The results indicate that C-NoMAD has good internal consistency.
Content validity
The results of content validity analysis show that the S-CVI was 0.95, which is above the recommended level of 0.8. And the I-CVI ranged from 0.857 to 1, except for the I-CVI of item #3 was 0.714.
Construct validity
Using AMOS 25.0 software, we verified the fit of the C-NoMAD to the NPT model. The CFA results showed that the factor loading of item #10 was less than 0.5. When unmodified, the RMSEA did not reach the recommended value. According to the hint of the modification indices, we set item #10 and #18 as error correlations. After being modified, all the fit indices reached the recommended value which means the C-NoMAD has acceptable construct validity (Table 4). However, item #3 “I understand how the [intervention] affects the nature of my own work” still had the lowest factor loading. Figure 2 presents the standardized factors loadings of C-NoMAD.
Correlations
Table 5 shows the positive correlations between four constructs’ scores and overall scores and three general questions scores. The Pearson correlation coefficients ranged from 0.251 to 0.476 (P < 0.01), which means their correlations were low to moderate.
Discussion
Our study translated the English NoMAD instrument into Chinese and performed the psychometric evaluation of the C-NoMAD in the context of the implementation of the pressure injuries management system via WeChat mini-program. The C-NoMAD is a brief quantitative tool to measure implementation sustainability for Chinese researchers.
There are some questionable items needed to be discussed. Item #3 “I understand how the [intervention] affects the nature of my own work”, the word “nature” in Chinese is a very abstract concept, our investigation shows that quite a lot of clinical professionals propose this item was hard to catch its meaning, although we tried many attempts to make it more understandable. Item 10 “The [intervention] disrupts working relationships.”, many participants asked the “working relationships” means which one relationship, nurse-to-nurse relationship or nurse-to-patient relationship, and so on. Item #12 “Work is assigned to those with skills appropriate to the [intervention].” The initial goal to develop the PI management system via WeChat mini-program is easy to operate and requires every clinical nurse in our study hospital can use it, so there is totally no working assignment problem.
For reliability, the internal consistency of C-NoMAD shows greater results than the other language version of NoMAD. The reason may be related that our study was only conducted in one hospital and assessed one intervention, and the other version assessed several interventions in different settings (e.g. the English version tested six interventions in six sites, and the Dutch version assessed one intervention in three groups).
For validity, the CFA shows that the C-NoMAD has an acceptable fit for NPT theoretical four-construct model after being modified. Item #3 had the lowest factors loading which is consistent with our interview result. And the C-NoMAD has good content validity, except for item #3. Accordingly, in the final version of C-NoMAD, we decided to delete item #3. The problem about item #3 had never been mentioned by the other language version of NoMAD. English, Swedish, and Dutch are Indo-European family of Germanic languages, however, Chinese belongs to Sino-Tibetan family of Chinese languages, the language family is different. Moreover, it may be affected by the diversity of eastern and western cultures, in terms of thinking style, westerners focus on rational, analytical and empirical, analyzing the overall integration as a whole, however, Chinese focus on intuitive, holistic and experience. So the word “nature” in item #3 “I understand how the [intervention] affects the nature of my own work” was too abstract to understand for Chinese. There were positive relationships between the part C four constructs score and part B three general questions score, which was consistent with the other language version.
In the Chinese version of NoMAD, we integrated the four constructs as a whole and renumbered item #1–19, not separate the part C into four sections, then we add explanations to the survey instructions “item#1–3 measure Coherence; item #4–7 measure Cognitive Participation; item #8–14 measure Collective Action and item #15-#19 measure Reflexive Monitoring”.
The Chinese version of NoMAD has 22 items with four dimensions, which is consistent with the structure of the normalization process theory. The tool has moderate items, easy to understand, simple to use, and generally takes 2 ~ 5 min to complete the test, which has good operability. When using the C-NoMAD, there are some suggestions. Firstly, because the part B three general questions are similar, it is necessary to highlight the different words such as “familiar” “is currently” and “will become” to remind respondents to pay attention. Secondly, in part C, in order to easy to understand for respondents, some expressions should be adjusted tailored to the specific situation, for example, item #2 “staff in this organisation” in our study should be adjusted to “nurses in our hospital”; item #9 “working relationships” should be adjusted into “nurse-to-patient relationships”; item #16 “the staff” should be adjusted into “nurses”.
In addition, the open-ended questions’ results about the participants’ comments on PI management system suggestions also provided new insight. The NoMAD is a structured measurement tool, which can quantify implementation problems. However, quantitative data can help us investigate the current implementation process, while qualitative data can help us explore its deeper reason. The qualitative feedback would guide us to better improve our implementation interventions and strategies. When using the NoMAD tool in the future, we recommend adding several open-ended questions related to the topic, which will be beneficial.
Limitations
Due to human, material, and time restrictions, this study evaluated an innovative intervention in only one hospital, involving only nursing staff, so the representativeness of the results is limited. And the findings suggested deleting item #3, requiring future research to justify it in different populations, interventions, and institutions. Furthermore, this study only investigated once and did not conduct a continuous follow-up of this PI management system in the implementation process to explore the dynamic implementation process, resulting in the results only reflecting the performance at that time, so future research about comparing the changes of implementation sustainability at various time nodes is necessary.
Conclusions
The Chinese version of NoMAD is a reliable and valid tool to evaluate the implementation process from the perspective of Chinese health professionals directly involved in the work of implementing complex interventions in the clinic. Simple and clear quantitative assessment tools can help clinical researchers, care managers, and policy makers identify facilitators and barriers when a new technology, approach, or complex intervention becomes routine in clinical practice. This study provides a basis for developing interventions that facilitate the clinical implementation of new technologies or approaches, and is important for accelerating the pace of biomedical research findings for human health.
Availability of data and materials
The dataset generated and analyzed during the current study are available from the first author or corresponding author on reasonable request.
Abbreviations
- CFI:
-
Comparative Fit Index
- CVI:
-
Content validity index
- I-CVI:
-
Item-level CVI
- NoMAD:
-
Normalization MeAsure Development
- NPT:
-
Normalization Process Theory
- PI:
-
Pressure injuries
- RMSEA:
-
Root mean square of approximation
- S-CVI:
-
Scale-level CVI
- SRMR:
-
Standardized Root Mean Square Residual
- TLI:
-
Tucker Lewis Index
- WLSMV:
-
Weighted Least Square Means and Variances
References
Theobald S, Brandes N, Gyapong M, El-Saharty S, Proctor E, Diaz T, Wanji S, Elloker S, Raven J, Elsey H, et al. Implementation research: new imperatives and opportunities in global health. Lancet. 2018;392(10160):2214–28.
Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychology. 2015;3(1):32.
Woolf SH. The Meaning of Translational Research and Why It Matters. JAMA. 2008;299(2):211–3.
Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Republished research: Implementation research: what it is and how to do it. Brit J Sport Med. 2014;48(8):731–6.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda. Adm Policy Ment Hlth. 2011;38(2):65–76.
Khadjesari Z, Boufkhed S, Vitoratou S, Schatte L, Ziemann A, Daskalopoulou C, Uglik-Marucha E, Sevdalis N, Hull L. Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implement Sci. 2020;15:66.
Slaghuis SS, Strating MMH, Bal RA, Nieboer AP. A framework and a measurement instrument for sustainability of work practices in long-term care. BMC Health Serv Res. 2011;11(1):314.
Finch TL, Rapley T, Girling M, Mair FS, Murray E, Treweek S, McColl E, Steen IN, May CR. Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol. Implement Sci. 2013;8(1):43.
Elf M, Nordmark S, Lyhagen J, Lindberg I, Finch T, Åberg AC. The Swedish version of the Normalization Process Theory Measure S-NoMAD: translation, adaptation, and pilot testing. Implement Sci. 2018;13(1):146.
Vis C, Ruwaard J, Finch T, Rapley T, de Beurs D, van Stel H, van Lettow B, Mol M, Kleiboer A, Riper H, et al. Toward an Objective Assessment of Implementation Processes for Innovations in Health Care: Psychometric Evaluation of the Normalization Measure Development (NoMAD) Questionnaire Among Mental Health Care Professionals. J Med Internet Res. 2019;21(2):e12376.
Loch AP, Finch T, Fonsi M, Soárez PCD. Cross-cultural adaptation of the NoMAD questionnaire to Brazilian Portuguese. Rev Assoc Med Bras. 2020;66(10):1383–90.
Muscat DM, Ceprnja D, Hobbs K, Gibson JA, Blumenthal C, Milad R, Burns C, Lau T, Flood V. Development and evaluation of a health literacy training program for allied health professionals: A pre-post study assessing impact and implementation outcomes. Health Promot J Aust. 2021;32:88–97.
Shared DMAF, Spencer-Bonilla G, Thota A, Organick P, Ponce OJ, Kunneman M, Giblon R, Branda ME, Sivly AL, Behnken E, et al. Normalization of a conversation tool to promote shared decision making about anticoagulation in patients with atrial fibrillation within a practical randomized trial of its effectiveness: a cross-sectional study. Trials. 2020;21(1):395.
Ervin K, Weller-Newton J, Phillips J. Primary healthcare clinicians’ positive perceptions of the implementation of telehealth during the COVID-19 pandemic using normalisation process theory. Aust J Prim Health. 2021;27(2):158–62.
Gillespie BM, Harbeck E, Lavin J, Gardiner T, Withers TK, Marshall AP. Using normalisation process theory to evaluate the implementation of a complex intervention to embed the surgical safety checklist. Bmc Health Serv Res. 2018;18:170.
Stewart D, Maclure K, Newham R, Gibson-Smith K, Bruce R, Cunningham S, Maclure A, Fry S, Mackerrow J, Bennie M. A cross-sectional survey of the pharmacy workforce in general practice in Scotland. Fam Pract. 2020;37:206–12.
Meloncelli N, Barnett A, de Jersey S. An implementation science approach for developing and implementing a dietitian-led model of care for gestational diabetes: a pre-post study. Bmc Pregnancy Childb. 2020;20:661.
Sturgiss EA, Elmitt N, Haesler E, van Weel C, Douglas K. Feasibility and acceptability of a physician-delivered weight management programme. Fam Pract. 2017;34(1):43–8.
Cook C, Finch T, Sharma S, Girling M, Rapley T, Vernazza CR. Developing oral health risk assessment as routine practice during early stages of clinical careers: A cross-sectional study of dental students using the NoMAD questionnaire. Eur J Dent Educ. 2019;24(1):169–76.
Ziegler E, Valaitis R, Yost J, Carter N, Risdon C. “Primary care is primary care”: Use of Normalization Process Theory to explore the implementation of primary care services for transgender individuals in Ontario. PLOS One. 2019;14(4):e0215873.
Rapley T, Girling M, Mair FS, Murray E, Treweek S, McColl E, Steen IN, May CR, Finch TL. Improving the normalization of complex interventions: part 1 - development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). Bmc Med Res Methodol. 2018;18(1):133.
Finch TL, Girling M, May CR, Mair FS, Murray E, Treweek S, McColl E, Steen IN, Cook C, Vernazza CR, et al. Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). Bmc Med Res Methodol. 2018;18(1):135.
May C, Finch T. Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory. Sociology. 2009;43(3):535–54.
May CR, Mair F, Finch T, Macfarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009;4(1):29.
Li Z, Lin F, Thalib L, Chaboyer W. Global prevalence and incidence of pressure injuries in hospitalised adult patients: A systematic review and meta-analysis. Int J Nurs Stud. 2020;105:103546.
Lavallée JF, Gray TA, Dumville J, Cullum N. Barriers and facilitators to preventing pressure ulcers in nursing home residents: A qualitative analysis informed by the Theoretical Domains Framework. Int J Nurs Stud. 2018;82:79–89.
Demarre L, Van Lancker A, Van Hecke A, Verhaeghe S, Grypdonck M, Lemey J, Annemans L, Beeckman D. The cost of prevention and treatment of pressure ulcers: A systematic review. Int J Nurs Stud. 2015;52(11):1754–74.
Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, Patel V, Haines A. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. Plos Med. 2013;10(1):e1001363.
Ng YC, Alexander S, Frith KH. Integration of Mobile Health Applications in Health Information Technology Initiatives: Expanding Opportunities for Nurse Participation in Population Health. Cin-Comput Inform Nu. 2018;36(5):209–13.
Zhang X, Wen D, Liang J, Lei J. How the public uses social media wechat to obtain health information in china: a survey study. BMC Med Inform Decis. 2017;17(S2):66.
ImpleMentAll: NoMAD Translation Guide (short version) translation from English to target language. 2021. Retrieved from https://www.implementall.eu/Translation%20Guide_NoMAD_IMAweb_wlogo.pdf.
Finch TL, Girling M, May CR, Mair FS, Murray E, Treweek S, Steen IN, McColl EM, Dickinson C, Rapley T. NoMAD: Implementation measure based on Normalization Process Theory. [Measurement instrument]. 2015. Retrieved from http://www.normalizationprocess.org.
Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educ Psychol Measur. 2013;73(6):913–34.
Mokkink LB, Prinsen CAC, Bouter LM, de Vet HCW, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105–13.
Terwee CB, Bot SDM, de Boer MR, van der Windt D, Knol DL, Dekker J, Bouter LA, de Vet HCW. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.
Polit DF, Beck CT. The content validity index: Are you sure you know what’s being reported? critique and recommendations. Res Nurs Health. 2006;29(5):489–97.
Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46.
Hu LT, Bentler PM. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Struct Equ Modeling. 1999;6(1):1–55.
Acknowledgements
We sincerely thank all clinical nurses who volunteered to take part in our study.
Funding
LH was funded by National Nature Science Foundation of China (71363004, 71663002) and National Research Training Program of Gansu provincial hospital (19SYPYA-4). QW was funded by Science and Technology Project of Gansu Province (20JR10RA637) and the Fundamental Research Funds for the Central Universities (lzujbky-2019–58, lzujbky-2022-30). The funding bodies played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
Conceptualization: MYJ, LH; Methodology: MYJ, QW, YFC, JC; Data collection: MYJ, DLS; Data analyses: MYJ, QW, YJZ; Writing Original draft: MYJ; Writing-Reviewing and Editing: TF; Supervision: LH. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The study was approved by the Ethics Committee of Nursing School of Lanzhou University (No. LZUHLXY20190062). All participants have signed the informed consent form.
Consent for publication
Not applicable.
Competing interests
None.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Jiang, M., Wang, Q., Finch, T. et al. Validity and reliability of the Chinese version of the Normalization MeAsure Development(NoMAD). BMC Health Serv Res 22, 1338 (2022). https://doi.org/10.1186/s12913-022-08737-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-022-08737-1