Evaluating a questionnaire to measure improvement initiatives in Swedish healthcare
© Andersson et al.; licensee BioMed Central Ltd. 2013
Received: 4 May 2012
Accepted: 31 January 2013
Published: 7 February 2013
Quality improvement initiatives have expanded recently within the healthcare sector. Studies have shown that less than 40% of these initiatives are successful, indicating the need for an instrument that can measure the progress and results of quality improvement initiatives and answer questions about how quality initiatives are conducted. The aim of the present study was to develop and test an instrument to measure improvement process and outcome in Swedish healthcare.
A questionnaire, founded on the Minnesota Innovation Survey (MIS), was developed in several steps. Items were merged and answer alternatives were revised. Employees participating in a county council improvement program received the web-based questionnaire. Data was analysed by descriptive statistics and correlation analysis. The questionnaire psychometric properties were investigated and an exploratory factor analysis was conducted.
The Swedish Improvement Measurement Questionnaire consists of 27 items. The Improvement Effectiveness Outcome dimension consists of three items and has a Cronbach’s alpha coefficient of 0.67. The Internal Improvement Processes dimension consists of eight sub-dimensions with a total of 24 items. Cronbach’s alpha coefficient for the complete dimension was 0.72. Three significant item correlations were found. A large involvement in the improvement initiative was shown and the majority of the respondents were satisfied with their work.
The psychometric property tests suggest initial support for the questionnaire to study and evaluate quality improvement initiatives in Swedish healthcare settings. The overall satisfaction with the quality improvement initiative correlates positively to the awareness of individual responsibilities.
KeywordsQuestionnaire development Psychometric test Improvement measurements Improvement program Questionnaire assessment Healthcare setting
The number of quality improvement initiatives has increased within the healthcare sector in recent decades. These efforts to improve quality can be seen as a response to demands for more cost-effectiveness and better medical results. However, studies have shown that less than 40% of these initiatives are successful . The reason why specific improvement initiatives in healthcare fail or succeed is, therefore, a central question in studies of planned change. The need for more evidence about how to organize and manage new quality initiatives is identified as an important task within studies of healthcare improvement [1, 2].
Surveys are a frequently used measurement tool in healthcare settings . Surveys for assessment of innovation climate and innovation cultures have been developed. One of those is the Creative Climate Questionnaire (CCQ) aiming to measure the climate in an organization regarding creativity and innovations . This survey was recently used in a study of implementation of new tools in primary healthcare centres . Staff and management were shown to differ in their assessment of the organizational climate at the unit, with managers scoring higher. Olsson et al.  developed a model (the Swedish OCM) connected with a survey to predict outcomes of organizational change. Their model is directed towards predicting success or failure within a change project. A European project (MARQuIS) developed a web-based survey to measure quality improvement strategies in acute care hospitals in the European Union . The survey consisted of four sections, one at an overall hospital quality improvement level, the other three on quality management for medical conditions (acute myocardial infarctions, acute appendicitis and deliveries). The most broadly used strategies were related to external assessments, such as ISO, while activities related to patient involvement were implemented less often.
To the best of our knowledge, there are no surveys today in a Swedish context that can answer questions about how quality improvement initiatives are conducted and develop within Swedish healthcare. Wanting to contribute to the understanding of the development of quality improvement initiatives in Swedish healthcare by conducting longitudinal studies on improvement initiatives, we needed a measurement mechanism. The Minnesota Innovation Survey (MIS) was found to be a comprehensive survey including different dimensions of innovations and at the same time was developed to measure over time . It has a broad focus on change processes as well as antecedents and motivations for/motors of change. Therefore the MIS survey, with its focus on investigating aspects of change, could serve as a foundation to develop an instrument to measure improvements. The aim of the present study was to develop and test an instrument, based on MIS, to measure how improvement processes develop in a Swedish healthcare context.
The county council improvement program – the empirical context
The quality improvement program started in 2007 and was a political investment with the vision and aim to make the county council a learning organization with welfare of patients in focus. The program is implemented both from the top management level and at individual departments/clinics/primary healthcare centres. The program is described on the county council website . One of the activities is the methodological guided improvement program inviting staff teams to work with an innovation idea in a program using the Breakthrough Series Collaborative methodology and supervisors/facilitators . As of autumn 2010 six of those programs had been started, involving about 130 teams and 610 staff members, the latest including staff and teams from some of the municipalities within the county council.
Minnesota innovation survey
The Swedish Improvement Measurement Questionnaire (SIMQ)
Permission was granted from the creators of the original MIS to use it as a foundation in developing a Swedish instrument to measure improvements. Extensive modification and development of the two suitable dimensions of the MIS was done in several steps. Research team meetings were held between the different steps and during this process different ways to validate the questionnaire were applied. The original survey in English was translated into Swedish by a professional translator. Literally translated words and/or sentences were edited into more idiomatic Swedish and words were adapted to fit the Swedish healthcare and county council organization.
A focus group discussion was conducted with five former participants from earlier improvement programs. The focus group interview was tape recorded and notes were taken. Following the focus group’s suggestions, some questions were paraphrased and others reworded. The answers and answer scales were revised and sometimes changed. Individual interviews were held with three members of improvement program support staff. Their views and ideas were considered in a new revision, some questions were merged and others were moved. An alternative (“Do not know”) was added to some questions.
An expert in quality management was then asked to review the revised questionnaire. Based on his suggestions a revision was made, items were removed and merged, and the questionnaire was shortened. Even if the changes made were too extensive to be able to use the new questionnaire as comparison, a back translation was conducted, by another translator, to compare that the two dimensions were still present. An introductory text was written to suit the study and Swedish context, and to fit the web layout. The questionnaire was entered into the web-based survey program esMaker NX2. An answer was required to all items with fixed scales; otherwise it was not possible to proceed with the questionnaire.
Background data consisted of demographic data about the participants, such as profession, gender and years of work experience. Other background data covered respondent’s previous experiences in improvement work and the time spent on different activities within the improvement work.
Participants and data collection
The present study contains data from two improvement programs, ongoing from September 2009 until November 2010. Employees within the county council (n=171), the municipalities (n=39), in all 210 participants in the two improvement programs received the survey. The participants received written and verbal information from the first author at the regular improvement program meetings. The survey was sent by e-mail and the informants consented by answering the web-based questionnaire. After one week and two weeks reminders were sent automatically to those who had not answered. The survey study was conducted according to general ethical standards and approved by the Regional Ethics Review board in Linköping, Sweden (Dnr 179–09).
Data was analyzed using Statistica version 8.0 (StatSoft, Tulsa, OK, USA). Descriptive statistics are presented in both actual frequencies and as percentages, range, mean, standard deviation (SD) and median. The questionnaire’s psychometric properties were investigated through internal consistency scale analysis and an exploratory factor analysis was conducted for the total dimensions as well as each sub-dimension containing more than one item. Cronbach’s alpha coefficients are presented at both dimension and sub-dimension levels and the floor/ceiling effect in percentages are presented for each item. At both dimension and sub-dimension level the number of items needed to reach a Cronbach' s alpha 0.7 was calculated. Correlations were calculated between the two dimensions. In addition participants’ written free comments are presented.
The Swedish Improvement Measurement Questionnaire (SIMQ)
Results from the dimensions “Improvement effectiveness outcome” and “internal improvement processes” 27 items, n (%)
Improvement effectiveness outcome (n=92)
Not at all (0)
A little (1)
Quite a bit (3)
A lot (4)
22. Overall, how satisfied are you with the progress that has been made in the work to develop the improvement idea during the past month
Quite a bit
24. How much does the improvement idea contribute to improving the work at your unit?
2.7 (1.0) / 3
Quite a bit
Far below (0)
Somewhat below (1)
As expected (2)
Somewhat above (3)
Far above (4)
23. To what extent is your progress with the improvement idea below or above your original expectations?
Internal Improvement Processes (8 sub dimensions)
Improvement Uncertainty (n=92)
Very easy (0)
Quite easy (1)
Quite difficult (3)
Very difficult (4)
2. How easy is it for you to know ahead of time what steps are necessary to develop the improvement idea?
Not at all (0)
Every other week (2)
Every week (3)
Every day (4)
7. How often in the past month did problems arise during development of the improvement idea?
0.917 (1.0) /1
Resource scarcity (n=92)
How much must your improvement idea compete with other activities within your unit, when it comes to
Not at all (0)
Quite a bit (3)
A lot (4)
35a. Economic resources?
35b. Material, space, and equipment?
Not at all
35c. Attention from the executive level?
35e. Time to work with the improvement idea?
Quite a bit
Standardization of procedures (n=92)
Very little (0)
Very much (4)
3. To what extent is your work on the improvement idea supported by the methods used in the improvement program?
Expectations of Rewards and Sanctions (n=92)
How likely is it that the following will occur if the goals of the improvement idea have been achieved:
Not likely (0)
Hardly likely (1)
Very likely (3)
Totally likely (4)
15a. Everyone involved, as a group, will be rewarded or recognized for their collective efforts
15b. Only some participants will be rewarded or recognized for their individual efforts
How likely is it that the following will occur if the goals of the improvement idea have not been achieved:
16a. Everyone involved, as a group, will be reprimanded or told to “shape up” to improve their efforts.
16b. Only some participants will be reprimanded or told to “shape up” to improve their efforts
Improvement Group Leadership (n=92)
Absolutely do not agree (0)
Mostly do not agree (1)
Mostly agree (3)
Absolutely agree (4)
10. The project leader of the improvement idea encourages the participants to take initiative
11. The participants involved in the improvement idea are aware of their individual responsibilities
12. The project leader for the improvement idea places great emphasis on getting the work done.
13. The project leader has great confidence in the participants involved in the improvement idea
Not at all (0)
Quite a bit (3)
A lot (4)
21. Do those involved in working with the improvement idea receive feedback from “improvement support”/their supervisor on how they can improve their work?
Quite a bit
Freedom to Express Doubts (n=92)
Absolutely do not agree (0)
Mostly do not agree (1)
Mostly agree (3)
Absolutely agree (4)
14. To avoid causing disharmony I often feel I cannot say what I think about the work on the improvement idea.
Absolutely do not agree
Learning Encouragement (n=92)
Absolutely does not apply (0)
Mostly does not apply (1)
Mostly apply (3)
33. If a colleague tries something new and fails, this is viewed as something that could harm her/his future career in the county council.
Mostly does not apply
34. The county council prioritizes experimenting with new ideas.
How much influence have you had on each of the following decisions that might have been made during the past month?
No decision made * (0)
Quite a bit (4)
A lot (5)
6a. Preparing goals and measures for the improvement idea? (n=91)
Quite a bit
6b. Deciding which activities should be carried out within the improvement idea? (n=90)
Quite a bit
6c. Deciding on economic funds and resources for the improvement idea? (n=64)
6d. Recruiting colleagues to work with the improvement idea? (n=71)
Participant characteristics and response rate
Sent out n
Answers n (%)
% of total answers (n/92)
Nurse (including midwife/other specialities)
Dimensions and items, Cronbach’s coefficient alpha, factor loadings and floor/ceiling effect for the Swedish Improvement Measurement Questionnaire (SIMQ) (n=92 when no other stated)
Cronbach’s coefficient alpha * (+/− needed items to reach 0.7 reliability)
Factor loadings calculated at each sub dimension *
Factor loadings calculated at dimension level
Floor/Ceiling effect (%)
Improvement Effectiveness Outcome (3 items)
1 / 21
Progress meeting expectations
2 / 4
Improvement attains organizational goals
2 / 27
Internal Improvement processes (24 items)
Improvement Uncertainty (2 items)
Difficulty to know improvement steps
0 / 1
Frequency difficulty problems arise
1 / 46
Resource Scarcity (5 items)
Competition for finances
4 / 46
Competition for materials
1 / 52
Competition for management attention
5 / 34
Competition for personnel
10 / 24
Competition for time
22 / 4
Standardization of Procedures (1 item)
Details of rules and procedures
1 / 3
Decision Influence (4 items )
Deciding on improvement goals (n=91)
0 / 38
Deciding on work to be done (n=90)
0 / 39
Deciding on funding (n=64)
42 / 4
Deciding on personnel recruitment (n=71)
23 / 14
Expectations of Rewards and Sanctions **
Individual level (2 items)
0.60 ( +1)
Chance of individual reward
0 / 46
Chance of individual reprimand
0 / 51
Group level (2 items)
Chance of group reward
10 / 12
Chance of group reprimand
29 / 2
Improvement Group Leadership (5 items) ^
0.66 (+1) (0.76 (−1)) ^
1 / 40
Members clear about responsibilities
0 / 41
Emphasis on task
1 / 42
Leader puts trust in members
0 / 55
2 / 19
Freedom to Express Doubts (1 item)
Freedom to “rock the boat”
2 / 65
Learning Encouragement (2 items)
0.23 ^ ^
Failure not a career blight
0 / 34
Learning a high organizational priority
2 / 5
The Improvement Effectiveness Outcome item “Overall, how satisfied are you with the progress that has been made in the work to develop the improvement idea during the past month?” correlated significantly to three items in the Internal Improvement Processes dimension. Those were: “How much must your improvement idea compete with other activities within your unit, when it comes to: Time to work with the improvement idea?” (r=0.34, p=0.029); “The participants involved in the improvement idea are aware of their individual responsibilities” (r=0.35, p=0.024); and “To avoid causing disharmony I often feel I cannot say what I think about the work on the improvement idea” (r=0.53, p=0.000).
Background data results
The time spent on working with the improvement idea during the last month ranged from 0 to 80 hours and on average the participants spent 12 (SD 10.6) hours on this work. Most of the time was spent on the participant's own education, mean 3.2 (SD 4.6) hours, followed by time for planning and administration, mean 2.9 (SD 3.3) hours. Least time was spent on acquiring economic funds and resources, mean 0.2 (SD 0.6) hours.
Having prior experience working with improvements was stated by 30% (n=27) “Some”, 27% (n=25) “Quite a bit” and 2% (n=2) “A lot”, while 18% (n=17) answered “None” and 23% (n=21) “A little”. At the same time 50% (n=46) of the respondents stated having “No education” beforehand, 35% (n=32) stated “Participated in courses/training”, 10% (n=9) “University/college-level education” and 5% (n=5) “Other, specify below”. Those answering “Other” had mostly participated in earlier improvement programs.
Results from the Swedish Improvement Measurement Questionnaire
The dimension “Improvement Effectiveness Outcome” showed that the majority of the respondents were satisfied with their work and what they had accomplished, and they thought that the improvement idea contributed to improve the work at the unit, and that progress was above their expectations. The overall item “How much commitment do you feel toward the improvement idea?” showed a large engagement in the quality improvement initiative: 90% answered “Much/Very much”, 9% “Moderate” and 1% of the participants answered “Very little/Little” (Table 1).
The “Internal Improvement Processes” consist of eight sub-dimensions with a total of 24 items. The five items in “Resource Scarcity” affect the work with the improvement idea differently. A majority of the respondents stated that they had to compete for time to work with the improvement idea while competition for economic resources was mostly stated as “Not at all/A little”. Least competition was about materials, space and equipment. Regarding the item if the methods used supported the work almost half of the respondents answered, “Moderate” (46%). The respondents thought that they could express doubts about the improvement work, and that no one would be punished if they did not achieve the goals. For the dimension “Decision Influence” a high number of respondents stated that they had influence in the work with the improvement idea, such as deciding on measurements and activities, but not regarding resources and colleagues.
Written free comments
The most common comments were about time; not getting enough time to work with the improvement idea and that it was hard to find time because of regular tasks. There were also comments about manager support, such as wanting help from the manager to plan time for the team to meet. Other comments were about methods of measurements and how to show results. Need for evaluations and assessments to show improvements and distribute achieved results to other colleagues not involved were commented on. Suggestions on improving the initiative were about getting more knowledge and using unit development days to work with improvements.
The aim of this paper was to develop and test an instrument to measure improvement processes and outcomes in Swedish healthcare. A review by Rhydderch et al.  shows that there are some instruments tested to validate quality improvements, but none covering all stages required to properly fulfil design and development criteria. We did not find any existing survey that suited our aim, but some of the dimensions in the quite extensive MIS were suitable, and therefore, with permission from its creators, were used as a foundation . The revision was extensive, resulting in a different questionnaire altogether, still consisting of the two dimensions and sub-dimensions from the original survey, although reworded to better fit in the Swedish improvement context measured. The questionnaire was shortened to a large extent. Many of the earlier participants in the focus group and experts consulted agreed that the survey was too comprehensive to start with.
The sub-dimensions in “Internal Improvement Processes” vary greatly, such as items in “Standardization of Procedures”, “Expectations of Rewards and Sanctions” and “Learning Encouragement”. In two sub-dimensions there were only two items, consequently the factor analysis will only measure correlations. The four items in the sub-dimension “Expectations of Rewards and Sanctions” were divided into two parts due to their different focus; two are about rewards and sanctions at an individual level, and the other two at a group level. Doing this division left only two items in each part, making the factor analysis only calculate a correlation. Looking at the two different focuses, individual and group level, this division is arguably necessary. Most of the factor loadings for the items on a sub-dimension level, in dimensions containing of more than two items, were above 0.6, which is considered acceptable . The last item in the sub-dimension “Improvement Group Leadership” loads at 0.22. This item is about feedback from supervisors/improvement support and the other four items are about team leadership and responsibilities. Seeing that feedback is an interesting and important task, the item has not been removed. Although the overall Cronbach’s alpha was 0.72, some of the alpha scores of the sub-dimensions were quite low. Cronbach’s alpha is about internal consistency, and divergence of the items could explain those low values. Another explanation could be the fact that divided into sub-dimensions there are very few items, and calculating Cronbach’s coefficient alpha is problematic with only a few items. Within sub-dimensions there are differences in answer scales, therefore the results in Table 1 are presented in actual frequencies and percentages item by item as well as mean, SD and median . The sub-dimensions were not homogenous within themselves, and therefore the results are shown at item level, and no sum scales on dimension bases can be useful. The items are kept in the questionnaire however because of their nature, telling something important about the improvement processes. Strainer and Norman speak about content validation which is not based on any test or measurements, but on the judgement of experts regarding the substance and content of the items . During the development of the questionnaire, we tried to take this validation into account, first conducting a focus group discussion with former participants and then by consulting an expert in quality management. Between each development step, the authors had recurrent meetings discussing the changes made and the next step to take.
Some items show quite high floor/ceiling effects. Normally this indicates that the scales are too narrow to separate extremes . The possibility to tell something about those extremes doesn’t exist, and the variation of the scale is therefore often found to be too narrow, the variation too limited. In this kind of questionnaire, however, this must not be seen as a problem. If more than 50% of the respondents stated that the leaders trust the team members, this must be considered positive. Probably (and hopefully), a broader scale would not have changed that statement. Another problem is the zeros: if the scale is not fully used, the scale can not be considered a “five-point scale”. Perhaps the variation would not have been greater using a scale with more alternatives. The zeros in the endpoints can not be more then “Absolutely” in the scale ends. Then, one can argue, is there a need to measure if the majority is that positive? This questionnaire is to be used to measure the processes, repeated during the improvement program, and perhaps (and hopefully) some more differentiation will be shown over time. Another possible explanation may be the small sample size. The scales are different, and in some cases the questionnaire probably would have benefited from more consistent scales, although Strainer and Norman argue that it is more important to use words that make sense than to always obtain scale consistency .
There were not many significant correlations, but some interesting findings are that the overall satisfaction with the quality improvement initiatives correlates positively to the awareness of individual responsibilities and the feeling of openness, to express what you think about the work. Ekvall  describes this in terms of the organisation’s climate, implying a certain degree of openness, commitment, motivation and risk-taking mentality. The more positive the climate is, the more innovative the organisation and the more satisfied the employees will be. He also claims that risk-taking, dynamism and freedom play a role in creating an innovative organisation. In our study the items concerning decision influence did not show this. But the awareness of individual responsibility as well as the item about commitment (even if no correlations were found) can be factors having influence on satisfaction. Kvist et al.  also emphasize that people can not be managed to improve; they need to be motivated and encouraged to use their knowledge and abilities in a productive way.
The most common comments in our survey, however, were about lack of time to work with the improvement idea. The respondents thought they needed scheduled time so the whole team could meet and work together. The ordinary daily work always intruded. The time issue is supported by the fact that 52% stated that they had to compete for time to work with the improvement idea. At the same time, most respondents were satisfied with what they had accomplished, and thought their work was useful to the unit and to the healthcare organization. Respondents stated that they had to compete for time, which applies to the comments about lack of time. The least competition was mentioned with respect to economic resources. The fact that 62% stated that they did not have to compete for attention from management (executive level) is interesting. At the same time a recurring comment was about wanting more attention and support from management. Surprisingly there was a positive correlation between the overall satisfaction and the time competition with other activities. Kvist et al.  also found that important factors for perceptions of good quality were amount of work, content and influence of development, summarized as possibility to decide about one’s own work. In our study, most participants thought that they could influence the work, which may have contributed to the overall positive experience.
The response rate was 44%. The comparison between the participants showed that nurses were the largest group participating (Table 2). The possible number of participants was 210, but only 92 chose to answer the questionnaire. All we know about those who did not answer are their professions, and comparing to those who did answer, assistant nurses participated the least; only 28% completed the questionnaire. Amongst the other professions about half of the respondents answered, between 41-56% (Table 2). All the professions were represented in this study, to varying degrees. The reason why assistant nurses chose not to participate to such a large extent is not known. Lately, there has been a discussion about decreasing response rates in survey studies in Swedish healthcare . However, the participants in this study were participating in an improvement program, and this was an evaluation of that program, so one might have thought that the motivation to respond should be greater.
The Internal Improvement Processes dimension consists of eight quite divergent sub-dimensions, some of which are only made up of one or two items. Therefore the psychometric properties are below expected values. Four sub-categories, including the divided sanctions and reward dimension, consist of only two items each. Therefore the factor analysis will measure correlations instead. Two other sub-dimensions consist of only one item each, which makes psychometric analyzes impossible. Despite this, it was decided not to remove those items from the questionnaire, because we think they add information about the improvement processes and outcomes we wanted to investigate.
This paper was the first evaluation of the Swedish Improvement Measurement Questionnaire. It is also the first analysis of data following an improvement program using a Collaborative methodology. More data will be collected in this county council quality improvement program, and more analysis of the improvement processes and outcomes in Swedish healthcare settings is forthcoming. Although the questionnaire was developed to fit the Swedish healthcare context, we think that other, similar healthcare systems could make use of the questionnaire, investigating how their improvement efforts are developed. The questionnaire was intended to be quite short, and therefore possible to handle within healthcare. This was an important issue stated by all participants helping us to validate the questionnaire during the different development steps.
The psychometric property tests, although divergent, suggest initial support for the questionnaire to follow and evaluate quality improvement initiatives in Swedish healthcare settings. The questionnaire would, however, benefit from more development regarding the extent, language and uniform items and standardized measurement scales.
- Olsson J, Elg M, Lindblad S: System characteristics of healthcare organizations conducting successful improvements. J Health Organizat Manag. 2007, 21: 283-296. 10.1108/14777260710751744.View ArticleGoogle Scholar
- Walshe K: Pseudoinnovation: the development and spread of healthcare quality improvement methodologies. Int J Qual Health Care. 2009, 21: 153-159. 10.1093/intqhc/mzp012.View ArticlePubMedGoogle Scholar
- Streiner DL, Norman GR: Health Measurement Scales, a practical guide to their development and use. 2008, Oxford: Oxford University Press, 4thView ArticleGoogle Scholar
- Ekvall G: Organizational Climate for Creativity and Innovation. Eur J Work and Organ Psychol. 1996, 5: 105-123. 10.1080/13594329608414845.View ArticleGoogle Scholar
- Carlfjord S, Andersson A, Nilsen P, Bendtsen P, Lindberg M: The importance of organizational climate and implementation strategy at the introduction of a new working tool in primary health care. J Eval Clin Pract. 2010, 16: 1326-1332. 10.1111/j.1365-2753.2009.01336.x.View ArticlePubMedGoogle Scholar
- Olsson JA, Øvretveit J, Kammerlind P: Developing and Testing a Model to Predict Outcomes of Organizational Change. Qual Manag Health Care. 2003, 12: 240-249. 10.1136/qhc.12.4.240.View ArticlePubMedGoogle Scholar
- Lombarts MJMH, Rupp I, Vallejo P, Suñol R, Klazinga NS: Application of quality improvement strategies in 389 European hospitals: results of the MARQuIS project. Qual Saf Health Care. 2009, 18: i28-i37. 10.1136/qshc.2008.029363.View ArticlePubMedPubMed CentralGoogle Scholar
- Research on Management of Innovation: The Minnesota Studies. Edited by: Ven AH, Angle HL, Poole MS. 2000, Oxford: Oxford University PressGoogle Scholar
- Kvalitetswebben (in Swedish): http://www.ltkalmar.se/lttemplates/SubjectPage____2226.aspx.
- IHI: The Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement. 2003Google Scholar
- Rhydderch M, Edwards A, Elwyn G, Marshall M, Engels Y, Van den Hombergh P, Grol R: Organizational assessment in general practice: a systematic review and implications for quality improvement. J Eval Clin Pract. 2004, 11 (4): 366-378.View ArticleGoogle Scholar
- Pett MA, Lackey NR, Sullivan JJ: Making sense of factor analysis: the use of factor analysis for instrument development in health care research. 2003, Thousand Oaks, California: Sage PublicationsView ArticleGoogle Scholar
- Hair JF, Black WC, Babin BJ, Anderson RA: Multivariate Data Analysis: A Global Perspective. 2010, Pearson International Edition, 7thGoogle Scholar
- Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiology. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.View ArticleGoogle Scholar
- Kvist T, Vehviläinen-Julkunen K, Jokela V: Do Organizational Factors Explain the Quality of Care?. J Nurs Care Qual. 2007, 22 (4): 365-370. 10.1097/01.NCQ.0000290419.73134.6e.View ArticlePubMedGoogle Scholar
- Herlitz C: Svenskarna nobbar sexundersökningar – nya metodologiska grepp krävs (in Swedish). http://www.lakartidningen.se/07engine.php?articleId=16973.
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/48/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.