Skip to main content
  • Research article
  • Open access
  • Published:

A framework for cross-cultural development and implementation of complex interventions to improve palliative care in nursing homes: the PACE steps to success programme



The PACE Steps to Success programme is a complex educational and development intervention to improve palliative care in nursing homes. Little research has investigated processes in the cross-cultural adaptation and implementation of interventions in palliative care across countries, taking account of differences in health and social care systems, legal and regulatory policies, and cultural norms. This paper describes a framework for the cross-cultural development and support necessary to implement such an intervention, taking the PACE Steps to Success programme as an exemplar.


The PACE Steps to Success programme was implemented as part of the PACE cluster randomised control trial in seven European countries. A three stage approach was used, a) preparation of resources; b) training in the intervention using a train-the-trainers model; and c) cascading support throughout the implementation. All stages were underpinned by cross-cultural adaptation, including recognising legal and cultural norms, sensitivities and languages. This paper draws upon collated evidence from minutes of international meetings, evaluations of training delivered, interviews with those delivering the intervention in nursing homes and providing and/or receiving support.


Seventy eight nursing homes participated in the trial, with half randomized to receive the intervention, 3638 nurses/care assistants were identified at baseline. In each country, 1–3 trainers were selected (total n = 16) to deliver the intervention. A framework was used to guide the cross-cultural adaptation and implementation. Adaptation of three English training resources for different groups of staff consisted of simplification of content, identification of validated implementation tools, a review in 2 nursing homes in each country, and translation into local languages. The same training was provided to all country trainers who cascaded it into intervention nursing homes in local languages, and facilitated it via in-house PACE coordinators. Support was cascaded from country trainers to staff implementing the intervention.


There is little guidance on how to adapt complex interventions developed in one country and language to international contexts. This framework for cross-cultural adaptation and implementation of a complex educational and development intervention may be useful to others seeking to transfer quality improvement initiatives in other contexts.

Peer Review reports


There is evidence that palliative care benefits people with life limiting conditions at all ages and has been endorsed by the World Health Assembly [1]. Palliative care seeks to improve quality of life, by addressing physicial, psychosocial and spiritual needs, and is regarded as a complex intervention best delivered by a multidisciplinary team [2, 3]. The Lancet Commission has highlighted the globally inadequate current provision of palliative care and pain relief, especially for older people [4].

Nursing homes, defined here as care homes or long term care facilities with on-site nurses, are an important place of care for a proportion of older people with high levels of physical, psychological and or social need, including those with dementia [5, 6]. Nursing home staff may have limited care qualifications, low salaries and high turnover [7, 8]. To address the needs of residents who die in these settings, palliative care interventions have been developed to support staff to deliver care for dying residents such as the Gold Standards Framework for care homes [8] and the ‘Route to Success’ programme [9, 10]. Studies suggest that such interventions increase staff knowledge and confidence to care for older residents and their families, as well as decrease the proportion of residents transferred to hospital to die [11,12,13]. All interventions are initially developed within specific cultural, legal and linguistic contexts. Failure to adequately test novel interventions and ensure their safe and effective implementation may result in inadequate training and insensitive care as illustrated by the Liverpool Care Pathway, a British end of life care intervention that was withdrawn following public protests [14].

Kitson et al. [15] acknowledge the complexity of introducing change in practice and argue it is a balance between the evidence incorporated within the new programme, the context into which it is being implemented and the degree of facilitation required [16,17,18]. The Promoting Action on Research Implementation in Health Services (PARiHS) framework suggests that there is a continuum from ‘low to high’ ‘weak to strong’ in relation to the level of the evidence, context and facilitation [19, 20]. A high facilitation model has been shown to be beneficial when implementing a complex palliative care intervention into nursing homes [12, 21].

There is little guidance on cross-cultural adaptation of palliative care interventions, where the potential sensitivities and cultural aspects of dying are acknowledged. For example, disclosure of prognosis varies widely across Europe, as do legal and ethical regulations, such as advance directives or medication availability. This paper offers a framework for the cross-cultural development and support necessary to implement a complex palliative care intervention in nursing homes. The word framework describes the structure outlining the process undertaken, with the PACE Steps to Success programme used as an exemplar [22, 23].


The PACE Steps to Success programme was implemented as part of the PACE cluster randomised control trial across seven European countries to improve palliative care in nursing homes [23]. It was informed by the PARiHS framework [15].

The training programme and materials were prepared in English with the content being compiled from evidence of previous palliative care programmes in the UK. Materials were then translated to the langauges of participating countries. Two training events in the UK were delivered to 16 country trainers from the seven countries. A train-the-trainers model was adopted with the aim that training in the intervention and in specific teaching methods and styles would be cascaded from: international trainers to country trainers, country trainers to PACE coordinators, PACE coordinators to nursing home staff with all receiving considerable facilitation and support [15].

We draw upon collated evidence from minutes of three international consortium meetings, qualitative evaluation of training delivered through 34 group interviews with care staff delivering the intervention in nursing homes (a total of 151 staff), 25 group interviews with PACE coordinators (total of 73 PACE coordinators), 29 interviews with nursing home managers and an on-line group interview with 16 country trainers [24].

The cross-cultural development and implementation of the PACE Steps to Success programme followed three phases:

  • Phase 1: adaptation and preparation of resources;

  • Phase 2: training and implementation using a train-the trainer model;

  • Phase 3: supporting the implementation.

Phase 1: adaptation and preparation of resources

Complex interventions require careful description of underpinning evidence, procedures and processes to be followed prior to their implementation to ensure fidelity. In the PACE trial, this involved the development and cross-cultural adaptation of resources, written documents and tools (structured measures). All documents were initially written in English.

The PACE Steps to Success Programme drew upon the ‘Route to Success’ programme [10] orginially developed for England and Wales [25]. The tools were selected because they were appropriate for use within nursing homes, including residents with dementia, and this organisational setting [23].

The PACE Steps to Success comprised six sequential steps, namely: discussions about current and future care; assessment and review; monthly multi-disciplinary palliative care review meetings; delivery of high quality palliative care (focused on symptoms of pain and depression); care in the last days of life; and care after death (Fig. 1) [23].

Fig. 1
figure 1

A diagram of the PACE Steps to Success programme and their corresponding tools

Phase 2: training and implementation of the programme using the train-the-trainer model

There is evidence that the train-the-trainers model embeds knowledge better than didactic education since those cascading knowledge listen more comprehensively to the training because they have to teach it to others [26]. It enhances sustainability of changes occurring in practice. In the PACE trial, implementation of the PACE Steps to Success programme used a train-the-trainers model that was cascaded through:

  • international experts - in English

  • within country trainers who visited each intervention arm nursing home every 10 to 14 days during the 12-month implementation period and were responsible for training the PACE coordinators based in each nursing home – in the local language.

  • PACE coordinators who were designated staff employed within the nursing homes, supported the sustainment of the implementation within the setting.

To ensure equity between countries, the country trainers were appointed by research partners using specific criteria (see Fig. 2), which indicated the skills and expertise, required.

Fig. 2
figure 2

Criteria for appointment of the Country Trainer

Phase 3: supporting the implementation

There is evidence that training alone may not be sufficient to embed changes in practice [27]. Therefore, we designed an implementation process that included cascading a high level of support and facilitation of the programme [28], informed by the PARiHS framework [15]. The nursing home context was perceived as ‘low’ in relation to its knowledge and practice of palliative care so required ‘high’ evidence and ‘high’ facilitation [15]. Examples of high level support and facilitation included: monthly internet-based international groups for country trainers and mentorship from national research leaders. Country trainers then supported the nursing home PACE coordinators by visiting each nursing home every 7–10 days.


In this section, we describe the cross-cultural adaptation processes in relation to the implementation of a complex intervention, highlighting them in the context of the three phases. The cross-cultural adaptation of the programme was regarded as permeating all aspects of the development and implementation of the programme (see Fig. 3). Results of the PACE cluster randomised control trial [29] and a formal evaluation of the PACE trial implementation process are reported elsewhere [24].

Fig. 3
figure 3

A cross-cultural adaptation framework

In total 78 nursing homes participated in the PACE trial, with half randomized to receive the intervention [29]. In each nursing home, one or more managers participated, and 3638 nurses and care assistants were identified at the start of the trial across all nursing homes. In each country, 1–3 trainers were selected (total n = 16) to deliver the intervention. The country trainers had diverse professional backgrounds including seven nurses, four physicians, three psychologists, one social worker and one sociologist. All country trainers were employed part-time, and most combined this with other roles. We report processes of implementation in relation to the three-phase framework used to guide the cross-cultural adaptation and implementation.

Adaptation and preparation of resources

The core document was discussed at an international team meeting, which included partners who worked with older people and people with dementia; the content of the document was reviewed and revised for cultural sensitivity and clinical appropriateness. The document was then reviewed by staff for acceptability, feasibility and cultural appropriateness in two nursing homes in each country who were not included in the trial. Two further documents were developed that built upon the core document. One for country trainers that included a detailed explanation of all training sessions to support the PACE coordinators to implement the programme (see Fig. 1). Another version for PACE coordinators had less information than the country trainers but more information than the core document. All documents were translated from English into trial country languages (see Fig. 4).

Fig. 4
figure 4

Flow chart – cross-cultural adaptation of resources

Preparation of resources was an iterative process. During meetings with the international project partners, it was agreed to simplify the content, focus on specific measurable outcomes and to introduce generic tools where these were not already in use in the nursing homes such as structured pain assessment forms. These discussions highlighted different cultural norms such as diagnostic disclosure practices, which influenced the acceptability of advance care planning (ACP) (Step 1). For example, while ACP was well understood in Belgium, the Netherlands, Switzerland and UK, it was not widely recognised in Finland, Italy and Poland [24]. There was considerable discussion regarding country differences in legal recognition of cardiac resuscitation orders and they were removed from the final document. Likewise, following much debate, assessment of specific symptoms was confined to pain and depression, rather than other generic symptom assessment. In Poland, for example, there was a greater hierarchical medical model compared to the UK; this meant that assessment of symptoms relied on medical staff rather than the nursing team as often is the situation in UK nursing homes. We also recognised differing national legislation and policies that for example influenced prescribing of opioids [30]; these were not available in nursing homes in Poland.

Training and implementation

The train-the-trainers model was applied by bringing all country trainers together for a one-day meeting to introduce the PACE Steps to Success programme and to meet their peers. This was followed by an intensive five-day training event three months later that involved outlining the PARiHS model [15], role modelling teaching styles, and, practising the training activities that country trainers would deliver in their own countries during the preliminary phase of the implementation to PACE coordinators based in nursing homes (see Fig. 5).

Fig. 5
figure 5

Flow chart to show training

The five-day training gave country trainers the opportunity to engage more fully with the PACE intervention and the resources, and to understand cultural differences in how general palliative and end of life care was managed in nursing homes in participating countries. Both these training events were conducted in English by two international trainers (JH, KF). During the training and afterwards, country trainers returned to their country and discussed with clinical colleagues the cultural differences in legal and ethical aspects of palliative care. Where necessary, further changes were made to the individual country resources.

Following the five-day training, country trainers organised two days of training for the PACE coordinators from the intervention arm nursing homes. This training was delivered in the local language and brought together all the PACE coordinators prior to the implementation of the PACE Steps to Success programme. PACE coordinators were qualified nurses or senior care assistants and normally there were two or three identified per nursing home, to allow for flexibility in working shifts. They helped to organise the monthly within nursing home training on the six steps being delivered by the country trainers. In larger nursing homes, the training was sometimes repeated as much as three times during the month, to ensure access for all staff. The training was for nursing home staff, medical staff and any other staff external to the nursing home who were involved in palliative care.

A number of cultural challenges became apparent; for example, hierarchical relationships between different professional disciplines which influenced communication and decision making towards the end of life. In countries such as Poland and Italy, nurses appeared to have a lower social status than physicians, so although they had more opportunities for interaction with family members of dying residents, more salience was afforded to medical communication about end of life decision making [31]. There were differences too in the educational level of those providing care to residents and how that care was documented, in paper or online records. In some countries, nursing homes used electronic care planning which included pain assessment scales which were different to those recommended in the PACE resources.

Supporting the implementation

Support was cascaded down and up through each level. Country trainers were supported by an international trainer in English via online groups, and secondly, by lead research partners in local languages. Country trainers in turn supported PACE coordinators within the nursing homes who assisted staff in implementing the intervention (see Fig. 6).

Fig. 6
figure 6

Flow chart – support for implementation

The online groups for the country trainers were facilitated in an action learning style whereby the international trainer used open questions about experiences and challenges encountered in implementing the programme, which also facilitated peer learning [32]. Once the groups became established, prearranged monthly on-line meetings were arranged. However, even with prior notice, the unpredictable nature of work meant that some country trainers were not able to attend these meetings due to demands from their other roles, personal commitments or illness. Another key issue for the country trainers attending the on-line support meeting was that the majority were not speaking in their first language.

Country trainers were regarded as key people in delivering the PACE intervention, but most had relatively isolated roles. Additional monthly support was given by the research leads. These meetings were designed to deal with predominantly practical and logistical concerns, but also addressed the emotional labour of the sensitive topics raised by the PACE Steps to Success programme.

A further dimension of support that needed to be integrated into the implementation process concerned the palliative care focus of the intervention. In some countries, explicitly talking about dying with the residents, rather than relatives, and making plans for the future such as ACP, was not culturally acceptable. For example in Italy and Poland, end of life communication and decision making was normally conducted with family members rather than residents [31] which meant that Step 1 was poorly implemented.

The role-modelling support by country trainers to PACE coordinators was regarded as showing the importance of facilitation and helped with organisational and practical changes. PACE coordinators were at the forefront of addressing barriers to change, and used their pre-existing relationships with nursing home staff, managers and external professional staff. Supporting staff in the nursing homes to address culturally challenging issues created demands both for the country trainers and the PACE coordinators. For example, in the UK where most nursing homes are independent ‘for-profit’ organisations, the country trainer became aware that nursing home staff often lacked access to evidence-based resources and mutual support, so she established a ‘Facebook’ group which successfully overcame their perceived isolation. It also facilitated exchange of resource material. The leadership ability and continuity within the nursing home was also of particular importance. The support of the PACE programme by the nursing home manager was critical for a good outcome.


This paper highlights the importance of a structured framework for cross-cultural adaptation and implementation of a complex educational and development intervention (which has been designed for one country and language) when transferring it to international contexts. By coordination and integration of the three phases, namely, adaptation and preparation of resources, delivering the intervention within a train-the-trainers model, and cascading support throughout those facilitating the intervention, we anticipate that this framework may have a resonance and applicability beyond the PACE project. The PACE project was largely implemented in well resourced countries, so how such a framework is used in low-middle resourced countries needs further research.

Summary of the implementation process of the PACE steps to success programme

This account of the design, adaptation and execution of a complex palliative care intervention for nursing homes provides evidence of the important methodological and practical issues that arise in implementing interventions for residents near the end of life. Using the three phases, we successfully adapted a British programme for use in European nursing homes. The final version of the PACE Steps to Success Programme Information Pack and tools are now freely available in Dutch, English, Flemmish, Finnish, Italian and Polish (French forthcoming) [33]. As anticipated we faced a number of challenges during implementation related to the different stages of development of palliative care and its integration into the nursing home context [6], and hierarchical organisational structures in nursing homes, and unexpected barriers such as their apparent isolation from other similar organisations. Overall, implementation quality was variable, with some difference in staff attendance at training between countries and facilities as described more fully in the process evaluation [24].

Adoption of evidence-based guidelines into practice present some difficulties within the nursing home context because of low levels of staff qualifications, high staff turnover and limited investment in education [34]. However, there is evidence that nursing homes are keen to embrace palliative care [21, 35] despite the considerable barriers that are often present [36]. Both a bottom up and a top down approach to change is important within the often hierarchical structure of nursing home organisations. The dynamic sustainability framework highlights that there needs to be a ‘fit’ between an intervention and the context in order to optimize benefit [37]. However, there was limited opportunity for flexibility within the PACE Steps to Success programme because it was implemented within the context of a cluster randomised control trial [23].

The operationalisation of complex interventions into core elements with clear guidance on implementation processes are recommended. The preparation of resource materials needs to achieve a balance between detailed instructions, length of documents and ease of reading for busy clinicians. In the context of the PACE trial, we adapted three documents for the PACE Steps to Success programme, drawing upon an initial English version. Whilst the documents were always available to be referred to, and a constant reminder of the nursing home’s involvement in the intervention, they were often kept in the manager’s office with little evidence that care workers and nursing staff used them. Availability of online resources might provide better options for nursing homes with technologically advanced health care systems.

The train-the-trainers model was a means of cascading knowledge and skills from the UK international trainers, to country trainers within the seven European countries, to PACE Coordinators within each nursing home, and, then to nurses and other workers caring for residents with palliative care needs on a daily basis in nursing homes. When comparing this to a similar large study in the USA [26], the PACE study was arguably more challenging because of the different languages and cultures throughout Europe. There were also organisational cultural differences across nursing homes partly due to the differing funding models [6]. For organisational culture to change, it requires the leadership to be willing to adapt to new ways of doing things [38].

Within the PACE project, considerable emphasis was put on the facilitation and support process from the beginning. Previous work in the UK on complex palliative care interventions in nursing homes had found the PARiHS framework useful to guide the implementation process [11, 20]. The PARiHS framework takes account of the type and nature of the evidence being introduced, the social and organisational context and the elements that facilitate the implementation – if either the evidence or the organisational context are ‘weak’ then the facilitation within the intervention needs to be ‘strong’ [15]. A cluster randomised control trial implementing a palliative care programme found a significant association between the intensity of external facilitation and nursing homes completing the implementation through to accreditation [21, 39]. Those nursing homes that received both high facilitation and action learning (where the manager were involved in monthly action learning sets) had significantly better results. It appears that the individual nursing home culture plays a considerable part in it’s readiness for change and willingness to accept the facilitation and support being offered, as highlighted in previous research [40, 41].

Recent evidence from the PARiHS group in their international randomised controlled trial in long term care facilities examines in more depth the role of facilitation when bringing about change [41]. The study highlights the significance of organisations in prioritising commitment to change. Whilst the PACE Coordinators were willing to participate and were appointed by the nursing home managers, sometimes the authority given to them was not sufficient to implement changes in practice. PACE Coordinators needed to be able to be internal facilitators of change, and the skills required to do this were not always available within the nursing homes. Further work is required to understand the different impacts of external and internal facilitation upon the implementation processes within nursing homes.

Strengths and limitations

The strength of the framework is the integration of three levels of cross-cultural development within the implementation. We were fortunate to draw upon international experts and international advocacy organisations such as Alzheimer’s Europe, European Association for Palliative Care and Age Platform, including the input of people with dementia, to assist in the cross-cultural adaptation processes. This variety of input from seven countries increases the applicability of the framework to other settings. However, the methods used in developing the framework do not enable us to verify our findings, except by presenting the PACE Steps to Success as an exemplar. Our implementation activities were shaped, and to some extent constrained, because the PACE Steps to Success intervention was tested within a cluster randomised controlled trial. Therefore, it did not allow for a lot of flexibility in implementation. The framework remains to be tested in implementing other interventions.

A limitation of our study is the difficulty of contextualising a structured intervention in an institutional environment that continually shifts and transforms, as resident’s needs, and staff, change. A further limitation in the study was the dominance of the English language and the cultural assumptions that underpinned the initial programme and training. For example, the difficulty in translating English metaphors or idioms became readily apparent when translations were made.

The PACE Steps to Success programme was initially drafted without input from those involved in the day-to-day care of residents in nursing homes in the seven countries. As a result there was a lack of awareness of a number of things. The cultural sensitivities and practicalities for those working in countries where general palliative care was largely unknown outside oncology settings. Further still, whilst the PACE programme and tools were considered very important, they were paper-based; at the time the study was being designed, few UK nursing homes had electronic care planning systems. This was in contrast to many nursing homes within the majority of PACE countries who already had electronic records in place within their nursing homes. As the PACE intervention used paper copy tools, there was tension between the two systems and potential redundancy of effort. It is important in future that tools are integrated into the nursing home record system so that staff can use them more effectively.

It is important to consider within this study whether the intensity of the programme itself was in fact ambitious within the limited period of of the trial. Not only was the programme attempting to implement a new palliative care organisational structure into each nursing home but it was also expecting staff to introduce new clinical tools. It could be argued that whilst both are important, a less linear approach to implementation and instead a two-stepped approach where one establishes the organisational structure first might have been better. In a final international meeting this was discussed with the importance of facilitating greater exterrnal multi-disciplinary support (such as monthly palliative care review meetings) and staff support following a resident’s death was seen as important starting points across cultures.


In conclusion, the framework for cross-cultural adaptation and implementation of a complex intervention may be useful to others seeking to transfer quality improvement initiatives in other contexts. The PACE Steps to Success intervention has provided an opportunity to look in depth at the process of cross-cultural adaptation of the intervention to improve palliative care in nursing homes. Three elements, namely: adapting and harmonising the resources, use of a train-the-trainers model, and cascading the support throughout the implementation period, have been identified as a possible framework with a focus on the importance of cross-cultural adapation within each element.

The framework requires further testing. More attention needs to be given during the design of the tools to the views of service users, nursing home staff and managers about the usefulness of the care model, opportunities and barriers within the context, and culturally sensitive outcomes.

Availability of data and materials

All data are archived at the Division of Health Research, Lancaster University, United Kingdom and at the relevant consortium universities and may be obtained from the corresponding author. As this paper concerns process and implementation, we have not placed the dataset in a public repository.



Jo Hockley


Katherine Froggatt


Palliative Care for Older People (name of the project)


Promoting Action on Research Implementation in Health Services


United Kingdom


United States of America


  1. World Health Assembly. WHA67.19 Strengthening of palliative care as a component of comprehensive care throughout the life course [Internet]. Sixty-seventh World Health Assembly. 2014. Accessed 29 Nov 2018.

  2. Sepulveda C, Marlin A, Yoshida T, Ullrich A. Palliative care: the World Health Organization’s global perspective. J Pain Symptom Manag. 2002;24(2):91–6.

    Article  Google Scholar 

  3. Radbruch L, Payne S. White paper on standards and norms for hospice and palliative care in Europe: part 1. Eur J Palliat Care. 2009;16(6):278–89.

    Google Scholar 

  4. Knaul FM, Farmer PE, Krakauer EL, De Lima L, Bhadelia A, Kwete XJ, et al. Alleviating the access abyss in palliative care and pain relief— an imperative of universal health coverage: the Lancet commission report. Lancet. 2017.

  5. Swagerty D. Integrating palliative Care in the Nursing Home: an Interprofessional opportunity. JAMDA. 2014.

  6. Froggatt K, Payne S, Morbey H, Edwards M, Finne-Soveri H, Gambassi G, et al. Palliative Care development in European care homes and nursing homes: application of a typology of implementation. JAMDA. 2017.

  7. Castle NG, Engberg J. Staff turnover and quality of Care in Nursing Homes. Med Care. 2005;43:616–26.

    Article  Google Scholar 

  8. Spilsbury K, Hewitt C, Stirk L, Bowman C. The relationship between nurse staffing and quality of care in nursing homes: a systematic review. Int J Nurs Studies. 2011;48(6):732–50.

    Article  Google Scholar 

  9. Thomas K. Delivering a gold standard of care at the end of life. J Care Serv Manage. 2009;3(2):155–63.

    Article  Google Scholar 

  10. National End of Life Care Programme. The Route to Success (care homes) 2010. NHS improving quality. UK 2010 http://endoflifecareambitionsorguk/wp-content/uploads/2016/09/Route-to-Success-Care-Homespdf Accessed 1 July 2018.

  11. Badger F, Plumridge G, Hewison A, Shaw KL, Thomas K, Clifford C. An evaluation of the impact of the gold standards framework on collaboration in end-of-life care in nursing homes. A qualitative and quantitative evaluation. Int J Nurs Studies. 2012;49(5):586–95.

    Article  Google Scholar 

  12. Hockley J, Watson J, Oxenham D, Murray SA. The integrated implementation of two end-of-life care tools in nursing care homes in the UK: an in-depth evaluation. Pall Med. 2010;24(8):828–38.

    Article  CAS  Google Scholar 

  13. O’Brien M, Kirten J, Knighting K, Roe B, Jack B. Improving end of life care in care homes; an evaluation of the six steps to success programme. BMC Palliat Care. 2016.

  14. Neuberger J. The Liverpool Care Pathway: what went right and what went wrong. Br J Hosp Med. 2016.

  15. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7:149–58.

    Article  CAS  Google Scholar 

  16. McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of ‘context’. J Adv Nurs. 2002;38(1):94–104.

    Article  Google Scholar 

  17. Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47(1):81–90.

    Article  Google Scholar 

  18. Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37(6):577–88.

    Article  Google Scholar 

  19. Setler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A Guide for applying a revised version of the PARiHS framework for implementation. Implement Sci. 2011.

  20. Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013.

  21. Kinley J, Stone L, Dewey M, Levy J, Stewart R, McCrone P, et al. The effect of using high facilitation when implementing the gold standards framework in care homes programme: a cluster randomised controlled trial. Palliat Med. 2014;28(9):1099–2109.

    Article  Google Scholar 

  22. Van den Block L, Smets T, van Dop N, Adang E, Andreasen P, Collingridge Moore D, et al. Comparing Palliative Care in Care Homes Across Europe (PACE): Protocol of a Cross-sectional Study of Deceased Residents in 6 EU Countries. JAMDA .2016;

  23. Smets T, Onwuteaka-Philipsen B, Miranda R, Pviodic L, Tanghe M, van Hout H, et al. Integrating palliative care in long-term care facilities across Europe (PACE): protocol of a cluster randomized controlled trial of the ‘PACE steps to success’ intervention in seven countries. BMC Palliative Care. 2018.

  24. Oosterveld-Vlug MG, Pasman HRW, ten Koppel M, Smets T, Tanghe M, Philips M, et al. Evaluating the implementation of the PACE Steps to Success Programme in long-term care facilities in seven countries according to the REAIM framework.

  25. Department of Health End of Life Care Strategy for England and Wales, Department of Health, London, 2008.

  26. Yarber L, Brownson CA, Jacob RR, Baker EA, Jones E, Baumann C, et al. Evaluating a train-the-trainer approach for improving capacity for evidence-based decision making in public health. BMC Health Serv Res. 2015.

  27. Froggatt K. Evaluating a palliative care education project in nursing homes. Int J Pall Nurs. 2000;6(3):140–6.

    Article  CAS  Google Scholar 

  28. Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008.

  29. Van den Block L, Honinx E, Pivodic L, Miranda R, Onwuteaka-Philipsen B, van Hout H, et al. Effectiveness of a palliative care programme for nursing homes in seven countries: the PACE cluster randomized controlled trial.

  30. Vranken MJ, Mantel-Teeuwisse AK, Junger S, Radbruch L, Lisman J, Scholten W, et al. Legal barriers in accessing opioid medicines: results of the ATOME quick scan of National Legislation of eastern European countries. J Pain Symptom Manag. 2014;48(6):1135–44.

    Article  Google Scholar 

  31. Baranska I, Kijowska V, Engels Y, Finne-Soveri H, Froggatt K, Gambassi G et al Perceptions of the quality of communication with physicians among relatives of dying residents of long-term care facilitites in 6 European Countries: PACE Cross-sectional study. JAMDA 2019;

  32. McGill I, Beatty L. Action learning. 2nd ed. London: Kogan Page; 2001.

    Google Scholar 

  33. Payne S, Froggatt K, Hockley J, Sowerby E, Collingridge Moore D, Kylänen M, et al. PACE steps to success Programme: information pack. Brussels: Vrije Universiteit; 2018.

    Google Scholar 

  34. Rahman AN, Applebaum RA, Schnelle JF, Simmons SF. Translating research into practice in nursing homes: can we close the gap? The Gerontologist. 2012.

  35. Brandt HE, Ooms ME, Deliens L, van Der Wal G, Ribbe MW. The last two days of life of nursing home patients – a nationwide study on causes of death and burdensome symptoms in the Netherlands. Palliat Med. 2006;20(5):533–40.

    Article  Google Scholar 

  36. Watson J, Hockley J, Dewar B. Barriers to implementing an integrated care pathway for the last days of life in nursing homes. Int J Pall Nurs. 2006;12(5):234–40.

    Article  Google Scholar 

  37. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013.

  38. Corazzini K, Twersky J, White HK, Buhr GT, McConnell ES, Weiner M, et al. Implementing culture change in nursing homes: an adaptive leadership framework. The Gerontologist. 2014;55(4):616–27.

    Article  Google Scholar 

  39. Kinley J, Stone L, Butt A, Kenyon B, Santos LN. Developing, implementing and sustaining an end-of-life care programme in residential care homes. Int J Pall Nurs. 2017;23(4):186–93.

    Article  Google Scholar 

  40. Goodman C, Sharpe R, Russell C, Meyer J, Gordon AL, Dening T, et al. Care home readiness: a rapid review and consensus workshops on how organisational context affects care home engagement with health care innovation. University of Hertfordshire 2017. Accessed 1 October 2018.

  41. Nilsen P, Wallerstedt B, Behm L, Ahlstrom G. Towards evidence-based palliative care in nursing homes in Sweden: a qualitative study informed by the organizational readiness to change theory. Implement Sci. 2018.

Download references


We are grateful to everyone who participated in the PACE project including all the country trainers and translators: Astrid Kodde, Bart Schweitzer (The Netherlands); Liesbeth van Humbeeck, Gwenda Albers (Belgium); Paula Andreasan, Teija Hammar, Rauha Heikkila (Finland); Nelly Simmen, Marisa Silva (Switzerland); Elżbieta Wesołek, Marta Kubik, Justyna Koniczuk-Kleja, Tomasz Ocetkiewicz (Poland); Viviana Forte, Suzanna Zecca (Italy); Elley Sowerby (UK).

We would also like to thank all those who participated within the nursing homes especially the PACE coordinators. We would also like to thank the PACE collaborators who are not in the author list including those who helped with the translation (Eddy Adang, Ilona Barańska, Monika Brzyska, Maud ten Koppel, Danni Collingridge-Moore, Violetta Kijowska, Outi Kuitunen-Kaija, Suvi Leppäaho, Federica Mammarella, Martina Mercuri, Emilie Morgan de Paula, Paola Rossi, Mariska Oosterveld-Vlug, Ivan Segat, Agata Stodolska and Marc Tanghe).

PACE consortium members: Lieve Van den Block (Chief Investigator) Borja Arrue, Ilona Baranska, Luc Deliens, Yvonne Engels, Harriet Finne-Soveri, Katherine Froggatt, Giovanni Gambassi, Viola Kijowska, Maud ten Koppel, Marika Kylanen, Federica Mammarella, Tinne Smets, Bregje Onwuteaka-Philipsen, Mariska Oosterveld-Vlug, Roeline Pasman, Sheila Payne, Ruth Piers, Lara Pivodic, Jenny van der Steen, Katarzyna Szczerbińska, Nele Van Den Noortgate, Hein van Hout, Anne Wichmann, Myrra Vernooij-Dassen, and the European Association for Palliative Care Onlus, Age Platform, European Forum for Primary Care, and Alzheimer Europe.

We presented an initial version of the framework at the 16th World Congress in Palliative Care.

Payne S, Hockley J, van den Block L, Onwuteake-Philipsen B, Kylanen M, Szczerbinska K et al. The cross-cultural development and implementation of a complex intervention to improve palliative care in nursing home: The PACE Steps to Success Programme Poster P01-515 presented at the 16th EAPC World Congress in Palliative Care, Berlin, Germany 2019 Accessed 27th September 2019.


This work was supported by the European Union’s Seventh Framework Programme (FP7/ 2007e2013) under grant agreement 603111 (PACE project Palliative Care for Older People). It has been co-funded by Polish Ministry of Science and Higher Education in the years 2014–2019 based on the decision no 3202/7PR/2014/2 (Nov. 25th 2014); and, co-funded by the Swiss Academy of Medical Science (2015–2017). The funders had no role in study design, collection, analysis or interpretation of the data, nor in the writing and the decision to submit this article for publication.

Author information

Authors and Affiliations




All authors (LVdB, SAP, KF, BOP, MK, KS, GG, JH, SP) were engaged in the preparation, refinement, testing and implementation of the PACE Steps to Success programme. LVdB, SAP, KF, BOP, MK, KS, GG, SP designed the underpinning PACE study. JH, KF, SAP further developed and adapted the PACE Steps to Success programme and KF, JH led the training. SAP, JH, KF drafted the paper and SAP, JH, KF, LVdB participated in the analysis and interpretation of the data. All authors read and approved the submitted manuscript and the revised versions. All authors have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Corresponding author

Correspondence to Sheila Alison Payne.

Ethics declarations

Ethics approval and consent to participate

This paper reports on the preparation, training, support and implementation activities linked to the PACE study where NHS ethical approval was obtained on 10th September 2015 from NRES Committee North East – Newcastle & North Tyneside (Ref: 15/NE/0261). All participants were informed that the discussions and preparation activities formed part of the PACE project. All participants in the main trial provided informed consent to participate. However, we do not report any patient, family or staff data in this paper. The wider PACE study was registered at – ISRCTN14741671 (FP7-HEALTH-2013-INNOVATION-1603111) July 30, 2015. Appropriate ethical approval was obtained in all partner countries.

Consent for publication

Not applicable.

Competing interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hockley, J., Froggatt, K., Van den Block, L. et al. A framework for cross-cultural development and implementation of complex interventions to improve palliative care in nursing homes: the PACE steps to success programme. BMC Health Serv Res 19, 745 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: