Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study
© O'Cathain et al; licensee BioMed Central Ltd. 2007
Received: 14 November 2006
Accepted: 14 June 2007
Published: 14 June 2007
Recently, there has been a surge of international interest in combining qualitative and quantitative methods in a single study – often called mixed methods research. It is timely to consider why and how mixed methods research is used in health services research (HSR).
Documentary analysis of proposals and reports of 75 mixed methods studies funded by a research commissioner of HSR in England between 1994 and 2004. Face-to-face semi-structured interviews with 20 researchers sampled from these studies.
18% (119/647) of HSR studies were classified as mixed methods research. In the documentation, comprehensiveness was the main driver for using mixed methods research, with researchers wanting to address a wider range of questions than quantitative methods alone would allow. Interviewees elaborated on this, identifying the need for qualitative research to engage with the complexity of health, health care interventions, and the environment in which studies took place. Motivations for adopting a mixed methods approach were not always based on the intrinsic value of mixed methods research for addressing the research question; they could be strategic, for example, to obtain funding. Mixed methods research was used in the context of evaluation, including randomised and non-randomised designs; survey and fieldwork exploratory studies; and instrument development. Studies drew on a limited number of methods – particularly surveys and individual interviews – but used methods in a wide range of roles.
Mixed methods research is common in HSR in the UK. Its use is driven by pragmatism rather than principle, motivated by the perceived deficit of quantitative methods alone to address the complexity of research in health care, as well as other more strategic gains. Methods are combined in a range of contexts, yet the emerging methodological contributions from HSR to the field of mixed methods research are currently limited to the single context of combining qualitative methods and randomised controlled trials. Health services researchers could further contribute to the development of mixed methods research in the contexts of instrument development, survey and fieldwork, and non-randomised evaluations.
Both qualitative and quantitative methods can be used in the same study. This is variously called 'multi-method', 'mixed methods' or 'multiple methods' research , although there is a move to standardise terminology and use the label 'mixed methods research' for studies combining qualitative and quantitative methods . There is an established body of knowledge about mixed methods research, discussing why this approach is used, how it can be used, and highlighting the challenges of using it in theory and in practice [3, 4]. Recently, there has been an increased interest in mixed methods research in the fields of social and educational research both in the United Kingdom (UK) [5–9] and North America [10, 11]. Over the last two years, journals devoted solely to mixed methods research have been launched – the Journal of Mixed Methods Research, and the International Journal of Multiple Research Approaches. Over the next two years at least half a dozen books on mixed methods research will be published by researchers in the UK, Europe and North America. Thus it is timely to consider why and how health services researchers use mixed methods research. This will help researchers to understand the relevance of the established and emerging body of knowledge on mixed methods research to their work. The aims of this paper are to describe why and how researchers undertake mixed methods studies in HSR and to consider whether researchers are exploiting the full range of justifications and types of approaches available to them.
Historically, health services researchers in the UK have used quantitative methodology. In the past decade or so they have welcomed qualitative methodology, detailing the contribution it can make to research in health care . Health services researchers have also combined qualitative and quantitative research in a single study and contributed to a renewed interest in mixed methods research, by making the case for mixed methods research in HSR  and giving overviews of the key issues in mixed methods research in HSR [14–16]. This interest in mixed methods research in HSR has also occurred outside the UK .
The main contribution of the HSR community in the UK to the body of knowledge about mixed methods research has been in the use of qualitative research alongside randomised controlled trials (RCTs). Health services researchers have detailed the contribution of qualitative methods within a pilot RCT ; encouraged the use of mixed methods within an iterative phased approach to trials  and within contextual evaluations undertaken alongside trials ; used qualitative research to improve the design and conduct of a trial ; described the challenges of undertaking a process evaluation ; detailed the process of exploring apparent discrepancies between findings from the qualitative and quantitative components of a pilot trial ; and described how to integrate largely qualitative process evaluations with trial data and findings .
Roles of different methods within a mixed method study
Defining the research question
A qualitative method can generate a hypothesis for a quantitative method to test , establish the theoretical framework for the quantitative method , or help conceptualise the whole study .
Addressing the range of research questions
Understanding how interventions work in the real world
A complex intervention may operate differently in practice from the original intention and qualitative research can address how an intervention is used in practice while quantitative research is used to measure outcomes . The strength of qualitative research to assess processes has been noted in social research .
Getting a range of perspectives
Qualitative research can help researchers to gain access to the views of participants while quantitative research allows researchers to explore their own agenda .
Designing the study
Determining the sample
A quantitative method can facilitate the sampling strategy for a qualitative method , for example a survey can distinguish representative from non-representative cases .
Improving the conduct of a method
When designing a trial, qualitative research may help to design appropriate recruitment strategies and information . This could be used for other quantitative methods such as surveys.
Designing study instruments
A qualitative method can help to design good survey instruments [16, 39, 41], and aid scale construction from them . In the context of evaluation, it can identify the outcomes important to different stakeholders, for inclusion within instruments .
Developing or optimising interventions
When evaluating an intervention like a service , qualitative methods can help to develop the intervention , develop an understanding of how the intervention works and who it might be most effective for , and indicate why the intervention has not worked .
The results from one method can affect the analysis of the other method, or qualitative and quantitative data can be combined for further understanding . For example, qualitative data can be 'quantitised', that is, numerically coded for analysis with the quantitative data.
Making use of the findings
Interpreting the findings
Each method can provide different aspects of a phenomenon . A qualitative method can explain factors underlying relationships in a quantitative study , confirm or contradict survey findings, interpret statistical relationships, explore puzzling responses or results, or offer case study illustrations . It may change the interpretation of findings , for example urging that a treatment is not rejected as ineffective simply because it was not used, but finding a way of it being used so that it might be effective . In the context of evaluation, qualitative methods can describe the context in which the study operates, in particular what is going on with controls, thus aiding interpretation .
A quantitative method can help to generalise a qualitative study , for example a survey can situate the context of case studies .
Qualitative methods can be used to consider the results of a study and their application within a real world context, drawing on pluralistic views of different stakeholders .
A mixed methods design was used to explore the use of mixed methods research in HSR. A documentary analysis of the proposals, reports and publications from mixed methods studies in HSR was undertaken to explore how mixed methods studies were undertaken. Interviews were undertaken with researchers from these studies to explore why researchers undertook mixed methods studies in the way they did. The two methods were used sequentially, with the documentary analysis undertaken before the interviews. The two methods were given equal priority. In terms of the purposes of combining methods, methods were combined both for complementarity, where each method addressed a different aspect of the research question, and for development where the quantitative component facilitated sampling for the qualitative component .
The Department of Health is a key commissioner of HSR in England and summaries of funded studies are listed on their website . This website was used as the source of HSR studies for this research. All summaries of research studies listed under ten programmes of research on the Department of Health website were read by one of the authors (AOC). Studies using primary health research were included. Studies undertaken as single studies rather than as part of a programme, initiative or fellowship were included because detailed summaries were available for the former whereas summaries were not available or had no methodological detail for latter types of studies. Projects with a quantitative and a qualitative component were classified as mixed methods studies. Details of this are described elsewhere . When a mixed methods study was identified, the lead researcher of each study was written to with a request for the research proposal, the final report for completed studies, and any emerging publications. Documentation was read by one researcher (AOC) and a number of issues around how the study had been undertaken were coded on a data extraction form. Issues included the methods used, roles of methods, priority and purpose of methods, approach taken to integration, quality of components, and types of publications emerging. The issues of relevance to this paper were whether a justification was given for using mixed methods and the roles of each method within a study. The data extraction form was structured, based on roles discussed in the literature. There was space for free-text comments for each structured item. For example, if a justification was given for using mixed methods research then this was written on the data extraction form.
The aim of the qualitative component of the study was to explore why researchers in HSR undertook studies in the way they did, and explore facilitators and barriers to this approach. Therefore it was relevant to interview researchers who had undertaken mixed methods studies in HSR. Researchers working on the studies included in the documentary analysis were sampled. Researchers' names were available from lists of applicants on proposals, lists of authors on reports, and lists of authors on articles. Purposive sampling was undertaken  to include a range of types of researchers – qualitative and quantitative researchers – and a range of types of mixed methods studies. An attempt was made to maximise variation within the sample by including research situated in different types of departments such as nursing, research units, primary care, and psychiatry; and research funded from different Department of Health programmes. Face-to-face semi-structured interviews were undertaken with researchers, focusing on their views of mixed methods studies generally and on the study included in the documentary analysis. Interviews lasted approximately one hour, were recorded, and transcribed verbatim.
For the documentary analysis, codes from the data extraction form were entered into SPSS. Percentages of studies in each category were calculated. Free-text comments were transcribed from the data extraction form into Word. Comments were read, themes were identified, and the frequency of each theme across the studies was counted. The interviews were analysed using the first stages of Framework . Framework was chosen as a suitable approach because it allows the researcher to explore their agenda explicitly while also allowing other themes to emerge from the analysis. A thematic framework was developed based on the research question and familiarisation with the first few transcripts, and then applied to each transcript using the computerised qualitative software package WinMAX . The data extracts for each theme or sub-theme were read and further coding was undertaken within them to organise and understand the data. Themes included paradigms, team working, quality of studies, justifications for using mixed methods and publishing studies. The theme of relevance to this article was the justifications given by researchers for undertaking mixed methods studies. When exploring justifications for using mixed methods research, the documents were used as the public face, and the interviews as the private face, of studies.
18% (119/647) of primary health research studies were classified as mixed methods research. Documentation was received for 81 studies and on reading the full documentation six studies were reclassified as not meeting the inclusion criteria, leaving 75 mixed methods studies. There were 45 proposals available for 75 studies (60%) and 48 reports available for 52 completed studies (92%) in the documentary analysis. Twenty-two researchers were approached for interview and 20 agreed to be interviewed.
Incidence of mixed methods studies in HSR
Incidence of mixed methods studies commissioned by the Department of Health Research & Development programme 1994–2004
Service Delivery and Organisation (SDO)
Health Technology and Assessment (HTA)
New and Emerging Applications of Technology (NEAT)
Maternal and child health
CVD and stroke
Primary secondary care interface
Primary dental care
Forensic mental health
Policy Research Programme (PRP)
Description of the 75 mixed methods studies and 20 interviewees
Description of 75 mixed methods studies in the documentary analysis and 20 interviewees
Characteristics of 75 studies
Year of funding
Type of study
Fieldwork and survey
Characteristics of 20 interviewees
N = 20
Type of researcher
Type of study
Evaluation with RCT
Survey and fieldwork
Justifications for using a mixed methods approach
Justifications were offered in both documents and interviews, including those related to the intrinsic value and strategic purpose of using a mixed methods approach.
Intrinsic value of the approach
Justifications given in documents for using mixed methods research
Proposals (N = 45)
Reports (N = 47)*
Confidence in findings
Good quality research
During the interviews, researchers' discussions of mixed methods research confirmed and elaborated some of the findings of the documentary analysis. Interviewees cited comprehensiveness as a driving force for the use of mixed methods research in HSR, wanting to address a range of questions and obtain a broader picture of a phenomenon. A comprehensive approach was seen as necessary due to the complexity of the issues under study, either the disease or the intervention, or the research environment in which the study was undertaken. The research environment was seen as particularly complex for policy-related research, with qualitative research undertaken to describe and understand a changing complex health service.
I'm not saying all the time, but a lot of the time in research it's difficult to get the whole picture without both. R12
It's less about the intellectual issue of mixed methods, it's more about the context in which those studies are conducted. And they kind, it seems to me they are necessary in areas of rapidly changing policy and practice. And because that's where they are conducted, they are inevitably complex and messy. R4
One argument for undertaking mixed methods studies was more prominent in the interviews than in the documentary analysis. Researchers associated qualitative research with gaining the views of patients. The patient voice was perceived as important in HSR because of its usefulness in understanding the complexity of a disease, an outcome, or an intervention, and grounding the research more in the real world. Service providers were also considered to be important voices for this reason.
Until you get down to hearing the actual experience, how people have described what the [intervention] was like for them and the problems they had with it, and the difficulties they had with it, as well as the positives, that you really get down to the nitty gritty, just what it is about this actual intervention that works and for who. R11
Thus the justifications for using a mixed methods approach were usually grounded in the applied nature of HSR, emanating from a need to engage with the real world and address policy related issues in a complex research environment, rather than any ideological stance. The desire to hear patient and provider voices was part of this applied and pragmatic approach rather than based on an ideology of emancipation of marginalised groups. Further, when discussing why they had taken a mixed methods approach, or why it was important to take such an approach, interviewees often justified the inclusion of a qualitative component within a study rather than justifying the use of a mixed methods approach. This may reflect the context of HSR in England as predominantly quantitative with an increasing acceptability and use of qualitative methods alongside quantitative methods. There was also a personal enthusiasm for mixed methods research amongst some of the researchers who felt that a justification was needed for why a study did not use a mixed methods approach. These researchers had been inspired to use mixed methods by other researchers or research projects earlier in their careers. Again, this enthusiasm was based on what researchers believed a mixed methods approach could deliver in the type of research field they worked in, rather than a belief in mixed methods research per se.
Using the approach for strategic purpose
Interviewees emphasised the need to undertake mixed methods research when the research questions demanded this approach.
it's got to be for the question. You can't just say 'we've all got to do mixed methods research'. It has to be 'what is the question, and which methods are the most appropriate ones to use in that circumstance', and that's got to be the driver. R17
This point was made as part of a concern that some funding bodies were 'into' mixed methods research, asking either explicitly or implicitly for this approach. These funding bodies were identified as pushing for the inclusion of qualitative research within totally quantitative studies and sometimes vice versa, thus forcing the existence of mixed methods studies. This 'push' was rarely explicit, where a funding body forced two sets of researchers to work together, but arose from researchers' perceptions that mixed methods research was required to obtain funding. This was discussed in the context of evaluative research, both randomised and non-randomised studies. Researchers feared that responding to funding bodies' desire for mixed methods studies could result in paying lip service to mixed methods research. Thus they shared a previously voiced concern in HSR that mixed methods studies may not be undertaken for their intrinsic value but more for a strategic purpose of obtaining funding .
So there is a sense in which in some studies you shoe horn a bit of qualitative work in because you think that will get you the funding. R7
AOC: Did [the funder] actually make a call for mixed methods?
I: I think they still use multi-disciplinary actually, which is not the same thing (laugh).
AOC: Right. That's how you read it when they say multi-disciplinary, you think...
I: That's now how I interpret it. R13
Obtaining funding was not the only strategic use of mixed methods research described by these interviewees. Other strategic uses discussed were undertaking qualitative research within a study as a safe guard against a null trial which might prove to be unpublishable without a qualitative component, and undertaking a survey within a study as a 'safety net' for dissemination because of the credibility it offered.
But sometimes it is handy to have that kind of safety net of, you know, a nice big survey behind your fieldwork. R10
Even if researchers did not discuss their own strategic uses of mixed methods research, they expressed concerns that the approach was a fashionable trend with a potentially detrimental effect on quality research.
This kind of mixed methods is a bit like apple pie, I mean, you know, people are thinking it's a good idea. The question is how it is done and for what purposes? R15
Characteristics of mixed methods studies
Characteristics of the 75 mixed methods studies in HSR
Proposal N = 43* % (n)
Report N = 48% (n)
Type of study
Fieldwork and survey
Purpose of the study
Focus group study
Other e.g. diaries
Other observational study
Other intervention study
Roles of methods
Roles of methods in mixed methods studies in HSR
Role of quantitative
Proposal (N = 43)
Report (N = 48)
Determine sample for qualitative
Generalise the qualitative findings
Provide topic guide for qualitative
Role of qualitative
Develop the research question
Establish theoretical framework
Generate content of instrument
Cognitively test instrument
Aid scale construction
Test validity of questionnaire
Study how intervention works
Study how the service works
Study intervention in practice
Views of intervention
Determine outcomes and measures
Improve trial methodology
Explore RCT as social construct
Facilitate user involvement
Explore an issue
Uncover issues inaccessible to quant
Explore acceptability of care
Explore unusual findings
Explore issues from quantitative
Explore identified unusual groups
Offer case illustrations
Offer depth information on new cases
Confirm a quantitative finding
Understand results in real world
The main roles of the qualitative components were to explore an issue, and generate the content of a questionnaire or measurement tool, the latter being a role specific to mixed methods studies (Table 6). Qualitative research was also used to study a range of aspects of an intervention or service. However, there were some gaps in the roles taken by the qualitative research compared with roles identified in the literature (Table 1). They were rarely used to generate hypotheses for testing within a study, and again, this may reflect the fact that single studies rather than programmes were included here. Their role in questionnaire development was clearly focused on identifying the content of a questionnaire and less so on further development of the questionnaire, for example, with cognitive testing. They were not used to determine which outcomes to measure in a study, and again this may reflect the fact that programmes of research were not included here.
Components could have more than one role within a study. For example, a qualitative component might be used both to explore an issue in its own right as well as to develop the content of a questionnaire. That is, a component might have a stand alone role as well as a supportive role in relation to another method.
Purposes and processes of combining methods
Purposes and processes of combining methods in 75 mixed methods studies in HSR
Proposal N = 43
Report N = 48
Purpose of combining methods
One fifth of HSR studies funded by the Department of Health in England between 1994 and 2004 were mixed methods studies, with some evidence that this had increased over time. The frequency of use may have been different if fellowships and programmes of research had been included in the study. Evidence elsewhere around the frequency of use of mixed methods research is based on publications rather than funded studies and thus there is no evidence to support or refute this finding. Other research indicates both lower and higher use of a mixed methods approach in the health field. For example, only 1% (37/3830) of papers in clinical journals were found to use both qualitative and quantitative methods, although the focus of the study had been to identify qualitative research ; and 10 of 26 (38%) evaluations located in health journals in 1995 used a mixed methods approach . In other research fields, it has been cited that 13% (145/1156) of articles in education journals used a mixed methods approach , and 8% (14/170) of primary research studies on long term conditions were mixed methods research . Despite the lack of supporting evidence, it appears that mixed methods studies are common enough in HSR to be identified as an important methodological approach warranting further consideration. Thus established and emerging literature on mixed methods research is highly relevant to the HSR community.
Researchers justified the use of a mixed methods approach on pragmatic rather than ideological grounds – they worked in an applied field studying complex issues in complex environments. Qualitative research helped them to address and understand these complexities, and bring in the voices of users and providers of services to help them to do so. A pragmatic justification for using mixed methods research has been found recently among social researchers in the UK . Thus this is not unique to the HSR community. Indeed although much of the established and emerging literature on combining qualitative and quantitative methods discusses the philosophical challenges of taking this approach, this literature also addresses a pragmatic stance [10, 11], making it highly relevant to HSR. However, a potential downside of the driver of mixed methods research being the practical need to use a range of methods is that researchers may not view their research in the context of the body of learning about mixed methods research, thus limiting the knowledge they yield from this approach .
The main justification for using a mixed methods approach in HSR was comprehensiveness rather than the range of justifications discussed in the literature. In particular researchers did not use a justification of increased validity when different methods with different strengths offer convergence of findings. This lack of use of classic triangulation, or confirmation, in HSR is welcome because concerns have been expressed about the difficulties of using methods with a purpose of confirmation , particularly as an indicator of validity . Having said this, confirmation is a key focus within much of the mixed methods literature and the HSR community will need to be aware of this when reading the literature about mixed methods research.
Researchers in HSR discussed the intrinsic value of mixed methods research but also discussed its use for strategic purpose. The main strategic use was to gain funding and researchers expressed concern about this because it might result in poor quality components of studies. Again, this was not confined to the HSR community because social researchers have also stressed the centrality of the research question in determining methods and expressed concerns that mixed methods research has become a fad because of funding bodies' desire for this approach .
Researchers in HSR drew on a range of both quantitative and qualitative methods but tended to make a lot of use of surveys and interviews. This frequency of use of interview studies in mixed methods research is very similar to social research where 71% of mixed methods articles were based on interview studies compared with 67% here . Of course the questions posed in HSR may be best addressed by individual interviews, but this may also indicate a neglect of potentially useful qualitative methods such as observation and documentary analysis. Researchers appeared to be drawing on a wide range of roles for the different methods within studies in the contexts of evaluations, survey and fieldwork, and instrument development. A lack of use of some roles might be due to the fact that they are best suited for use within programmes of research rather than single studies but nonetheless researchers may wish to consider the range of roles of methods detailed here and the relevance of these roles within their future research. A lot of use was made of predominantly quantitative designs which again may be most suitable for HSR or may indicate a lack of variety of designs.
Perhaps the most interesting finding here is that a combination of qualitative research with a randomised controlled trial is a minority of the types of mixed methods studies undertaken in HSR yet this is where health services researchers are making a strong contribution to the literature on mixed methods research. This may not seem surprising given the significance of the randomised controlled trial within HSR. However, it is important that researchers in HSR note the frequency with which they combine methods in the context of non-randomised evaluations, survey and fieldwork studies, and instrument development, and recognise that they can make a contribution to the development of mixed methods research in these contexts too.
This paper is based on an empirical study of mixed methods research in a specific research field. It focuses on why and how this approach is undertaken within HSR. The empirical study covered a number of issues of importance to undertaking mixed methods research in HSR which are not reported here, including paradigm differences between researchers, the effect of team working on research outputs, assessment of the quality of mixed methods studies, and the facilitators and barriers to integration within studies. These will be reported in further papers.
The responses to requests for documentation were representative of the specified population of mixed methods studies. However, there was a lower response to requests for proposals than reports. Assessment of the study documentation did not include double coding to check for inter-rater or intra-rater reliability. The studies here did not include all mixed methods studies in HSR funded in England between 1994 and 2004. HSR was funded by Regional Health Authorities, charities, and research councils over that time period. In addition, programmes, initiatives and fellowships were not included. There is no reason to believe that HSR funded through other sources is different from the HSR funded by the Department of Health, except in terms of the extent to which it was policy related. However, the research cultures of different countries in North America and Europe may be different from England and the findings are likely not to be generalisable outside the UK. Transferability is relevant to the findings from the qualitative component . The context of the qualitative research has been described to allow readers to consider the transferability of the findings to other settings. The context was researchers in HSR, mainly in England, where quantitative methodology has dominated historically.
Mixed methods research is common in HSR and the recent surge of interest in this approach internationally is highly relevant to the HSR community. Mixed methods research is used in HSR on pragmatic rather than ideological grounds, to engage with the variety of questions relevant to the complexity of health care. However, there is also strategic use of mixed methods research to gain funding and credibility, and concerns that this may hinder the utility of this approach. A range of methods, roles of methods and designs have been used in HSR but researchers may wish to reflect on the range available for use and their utility for addressing the range of questions in HSR. The HSR community has made a strong contribution to methodological development in the context of combining randomised controlled trials and qualitative research. It is in a position to make a strong contribution to methodological development in mixed methods research beyond this in the context of non-randomised evaluation, survey and fieldwork, and instrument development, and may wish to take the opportunity to do so.
Many thanks to the researchers who kindly sent copies of their study documents and gave their time and thoughts within the interviews. The Medical Research Council funded this study through their Fellowship Scheme.
- Stecher B, Borko H: Integrating findings from surveys and case studies: examples from a study of standards-based educational reform. Journal of Educational Policy. 2002, 17 (5): 547-569. 10.1080/02680930210158311.View ArticleGoogle Scholar
- Teddlie C, Tashakkori A: Major issues and controversies in the use of mixed methods in the social and behavioural sciences. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 3-50.Google Scholar
- Brannen J, (Ed): Mixing methods: qualitative and quantitative research. 1992, Aldershot: AshgateGoogle Scholar
- Bryman A: Quantity and quality in social research. 1988, London: RoutledgeView ArticleGoogle Scholar
- Bryman A: Integrating quantitative and qualitative research: how is it done?. Qualitative Research. 2006, 6: 97-113. 10.1177/1468794106058877.View ArticleGoogle Scholar
- Gorard S, Taylor C: Combining methods in educational and social research. 2004, Maidenhead: Open University PressGoogle Scholar
- Moran-Ellis J, Alexander VD, Cronin A, Dickinson M, Fielding J, Sleney J, Thomas H: Triangulation and integration: processes, claims and implications. Qualitative Research. 2006, 6 (1): 45-59. 10.1177/1468794106058870.View ArticleGoogle Scholar
- Bryman A: Paradigm peace and the implications for quality. International Journal of Social Research Methodology. 2006, 9: 111-126. 10.1080/13645570600595280.View ArticleGoogle Scholar
- Bryman A: Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research. 2007, 1 (1): 8-22. 10.1177/2345678906290531.View ArticleGoogle Scholar
- Tashakkori A, Teddlie C, (Eds): Handbook of mixed methods in social and behavioural research. 2003, London: SageGoogle Scholar
- Creswell JW: Research design. Qualitative, quantitative, and mixed methods approaches. 2003, London: Sage Publications;, SecondGoogle Scholar
- Pope C, Mays N: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. British Medical Journal. 1995, 311: 42-45.View ArticlePubMedPubMed CentralGoogle Scholar
- Barbour RS: The case for combining qualitative and quantitative approaches in health services research. Journal of Health Services Research and Policy. 1999, 4 (1): 39-43.PubMedGoogle Scholar
- O'Cathain A, Thomas K: Combining qualitative and quantitative methods. Qualitative Research in Health Care. Edited by: Pope C, Mays N. 2006, Oxford: Blackwell Publishing, 102-111. ThirdView ArticleGoogle Scholar
- Adamson J: Combined qualitative and quantitative designs. Handbook of health research methods Investigation, measurement and analysis. Edited by: Bowling A, Ebrahim S. 2005, Berkshire: Open University Press, 230-245.Google Scholar
- McDowell I, MacLean L: Blending qualitative and quantitative study methods in health services research. Health Informatics Journal. 1998, 4: 15-22.View ArticleGoogle Scholar
- Johnstone PL: Mixed methods, mixed methodology health services research in practice. Qualitative Health Research. 2004, 14 (2): 259-271. 10.1177/1049732303260610.View ArticlePubMedGoogle Scholar
- Bradley F, Wiles R, Kinmonth A-L, Mant D, Gantley M: Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). British Medical Journal. 1999, 318: 711-715.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. British Medical Journal. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.View ArticlePubMedPubMed CentralGoogle Scholar
- Wolff N: Randomised trials of socially complex interventions: promise or peril?. Journal of Health Services Research and Policy. 2001, 6 (2): 123-126. 10.1258/1355819011927224.View ArticlePubMedGoogle Scholar
- Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. BMJ. 2002, 325: 766-770. 10.1136/bmj.325.7367.766.View ArticlePubMedPubMed CentralGoogle Scholar
- Riley T, Hawe P, Shiell A: Contested ground: how should qualitative evidence inform the conduct of a community intervention trial?. Journal of Health Services Research and Policy. 2005, 10 (2): 103-110. 10.1258/1355819053559029.View ArticlePubMedGoogle Scholar
- Moffatt S, White M, Mackintosh J, Howel D: Using quantitative and qualitative data in health services research – what happens when mixed method findings conflict?. BMC Health Services Research. 2006, 6 (28).Google Scholar
- Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.View ArticlePubMedPubMed CentralGoogle Scholar
- Ong BN: The practice of health services research. 1993, London: Chapman and HallView ArticleGoogle Scholar
- Fulop N, Allen P, Clarke A, Black N: Issues in studying the organisation and delivery of health services. Studying the organisation and delivery of health services Research methods. Edited by: N Fulop PA, Clarke A, Black N. 2001, London: RoutledgeGoogle Scholar
- O'Cathain A, Murphy E, Nicholl J: Integration and publications as indicators of 'yield' from mixed methods studies. Journal of Mixed Methods Research. 2007, 1 (2): 147-163. 10.1177/1558689806299094.View ArticleGoogle Scholar
- Bowling A: Research Methods in Health. Investigating health and health services. 1997, Buckingham: Open University Press;Google Scholar
- Creswell JW, Clark VLP, Gutmann ML, Hanson WE: Advanced mixed methods research designs. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 209-240.Google Scholar
- Greene JC, Caracelli VJ, Graham WF: Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1989, 11 (3): 255-274. 10.2307/1163620.View ArticleGoogle Scholar
- Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998, 2 (16): 1-274.Google Scholar
- Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: RoutledgeGoogle Scholar
- Kuckartz U: WinMAX Software for qualitative data analysis. 1998, London: Scolari Sage PublicationsGoogle Scholar
- McKibbon KA, Gadd C: A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year. BMC Medical Informatics and Decision Making. 2004, 4 (11).Google Scholar
- Turner-Stokes L, Harding R, Sergeant J, Lupton C, McPherson K: Generating the evidence base for the National Service Framework (NSF) for long term conditions: a new research typology. Clinical Medicine. 2006, 6: 91-97.View ArticlePubMedGoogle Scholar
- Murphy E, Dingwall R: Qualitative methods in health services research. Health services research methods. Edited by: Black N, Brazier J, Fitzpatrick R, Reeves B. 1998, London: BMJ Books, 129-138.Google Scholar
- Bryman A: Quantitative and qualitative research: further reflections on their integration. Mixing methods: qualitative and quantitative research. Edited by: Brannen J. 1992, Aldershot: Ashgate, 57-78.Google Scholar
- Sieber SD: The integration of fieldwork and survey methods. The American Journal of Sociology. 1973, 78 (6): 1335-1359. 10.1086/225467.View ArticleGoogle Scholar
- Parry-Langdon N, Bloor M, Audrey S, Holliday J: Process evaluation of health promotion interventions. Policy & Politics. 2003, 31 (2): 207-216. 10.1332/030557303765371690.View ArticleGoogle Scholar
- Krause N: A comprehensive strategy for developing close-ended survey items for use in studies of older adults. Journal of Gerontology. 2002, 57 (5): S263-S274.View ArticleGoogle Scholar
- Rousseau N, McColl E, Eccles M, Hall L: Qualitative methods in implementation research. Changing professional practice: theory and practice of clinical guidelines implementation. Edited by: Thorsen T, Makela M. 1999, Copenhagen: DSI, 99-116.Google Scholar
- MRC: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research CouncilGoogle Scholar
- Caracelli VJ, Greene JC: Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1993, 15 (2): 195-207. 10.2307/1164421.View ArticleGoogle Scholar
- Weinholtz D, Kacer B, Rocklin T: Salvaging quantitative research with qualitative data. Qualitative Health Research. 1995, 5 (3): 388-397. 10.1177/104973239500500308.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/7/85/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.