- Research
- Open access
- Published:
Strategies to enhance risk communication about medicines in Malaysia: a Delphi study among multinational experts
BMC Health Services Research volume 24, Article number: 1019 (2024)
Abstract
Background
Effective risk communication about medicines is crucial to the success of all pharmacovigilance activities but remains a worldwide challenge. Risk communication has been conducted in Malaysia for decades, yet awareness on the communication methods remains low among healthcare professionals. While international guidelines are available, clear guidance on effectively communicating the risks of medicines in specific countries is scarce. This study aimed to establish a consensus on the priority strategies for enhancing risk communication about medicines by regulators.
Methods
We conducted a two-round modified Delphi survey among local and international communication experts, and also recipients of medicines risk communication in Malaysia. We developed a list of 37 strategies based on the findings of our previous studies. In Round 1, participants were asked to rate the priority for each strategy using a 5-point Likert scale and suggest additional strategies via free-text comments. Strategies scoring a mean of ≥ 3.75 were included in Round 2. We defined consensus for the final list of strategies a priori as > 75% agreement. Data were analysed using descriptive statistics and thematic analysis.
Results
Our final Delphi panel (n = 39, 93% response rate) comprised medicines communication experts from nine countries and Malaysian healthcare professionals. Following Round 1, we dropped 14 strategies and added 11 strategies proposed by panellists. In the second round, 21 strategies achieved consensus. The priority areas identified were to improve the format and content of risk communication, increase the use of technology, and increase collaboration with various stakeholders. Priority ratings for the strategy “to offer incentives to pharmaceutical companies which maintain effective communication systems” were significantly higher among recipients compared to communicators [χ2(1, N = 39) = 10.1; p = 0.039] and among local versus international panellists [χ2(1, N = 39) = 14.3; p = 0.007].
Conclusions
Our study identified 21 priority strategies, which were used to develop a strategic plan for enhancing medicines risk communication. This plan is potentially adaptable to all countries with developing pharmacovigilance systems. The difference in views between communicators and recipients, as well as local and international panellists, highlights the importance of involving multiple stakeholders in research.
Background
Medicinal products risk communication is an integral part of all pharmacovigilance processes [1]. Every medicine comes with benefits, but also carries the risk of adverse drug reactions. These risks need to be clearly communicated as part of pharmacovigilance risk minimisation activities to ensure the safe use of medicines. The importance of communication in pharmacovigilance has been discussed in international meetings since the 1990s [2, 3] and repeatedly highlighted in scientific literature [4,5,6]. Various measures have been taken to improve the effectiveness of communication, however, multiple challenges exist such as a lack of public trust in regulatory authorities, variable perceptions of risk depending on an individual’s knowledge, beliefs or experiences, health literacy gaps, and the more recent issues of misinformation or disinformation [1, 7, 8]. Thus, risk communication about medicines remains an important aspect of pharmacovigilance research.
Medicinal products are substances or combinations of substances intended to treat, prevent or diagnose a disease, or to restore, correct or modify physiological functions by exerting a pharmacological, immunological or metabolic action [9, 10]. Currently, there is no universally agreed definition for “medicinal product risk communication”. We have adapted the definition by Bahri [7], which describes the term as the structures, processes, and outcomes of information exchanges about risks and any concerns people may have with medicines, about the measures to support safe use and minimise risks and about risk governance overall in private, community and society spheres”. For simplicity, we use the term “medicines” to refer to “medicinal products”.
Many of the issues related to medicines risk communication may be considered global challenges, affecting almost all countries [8]. However, current research revealed that only a handful of countries have effective systems for communicating the risks associated with medicines [11]. For example among regulators, the European Medicines Agency (EMA) and the United States Food and Drug Administration have robust legislation on evaluating the effectiveness of risk communication, including requirements for the pharmaceutical industry to demonstrate the effectiveness of their risk communication. Bhasale et al. [11] reported that smaller regulators such as Health Canada and Therapeutics Goods Administration (TGA) Australia had legislation or regulations on risk communication but these did not fully describe the responsibilities of regulators and the industry. In contrast, NPRA Malaysia currently does not have legislation or guidelines specifically focused on risk communication [12]. While most countries face the same challenges in delivering effective risk communication about medicines, the difference lies in the resources, manpower and expertise available in each country to overcome these problems [13]. Several international bodies have released comprehensive guidelines on risk communication [14,15,16]. However the availability of expert guidance for specific countries is scarce [17, 18], especially in low- to middle-income countries.
In Malaysia, medicines risk communication has been carried out by the Pharmacovigilance Section of the National Pharmaceutical Regulatory Agency (NPRA) for over 30 years [19]. As the national regulatory authority, NPRA is tasked with ensuring the quality, efficacy and safety of pharmaceutical products in Malaysia. Currently, NPRA uses various risk communication methods including a national bulletin, safety alerts via email or social media, product package inserts, Direct Healthcare Professional Communication letters, press releases, and educational materials. Some of these communication materials are disseminated by pharmaceutical companies or other government agencies such as the Pharmacy Services Program, in collaboration with NPRA [19]. The majority of NPRA risk communication targets doctors and pharmacists, who perform the main roles of prescribing and dispensing medicines in Malaysia [20]. However, our previous analysis of real-world data revealed that the current risk communication efforts did not have a significant impact on ADR reporting and prescribing practice [21]. A nationwide survey conducted in 2021 also showed that awareness of risk communication methods among Malaysian doctors and pharmacists is generally low [19].
Factors that predict the usefulness of risk communication methods, preferences of respondents and suggestions to improve the risk communication have been previously published [19]. We have identified a list of strategies to enhance medicines risk communication in Malaysia through our previous survey [19] and systematic review [22]. However, a consensus from risk communication experts and recipients on which strategies should be prioritised in Malaysia has never been obtained. Faced with challenges such as budget constraints, lack of manpower, and lack of expertise [19, 23], it is impossible for regulators to simultaneously implement all the strategies identified. Therefore, our study aims to establish a consensus on the priority strategies to enhance risk communication about medicines by Malaysian regulators, using a modified Delphi survey with input from communicators and recipients.
Methods
This study is registered under the National Institute of Health [NMRR ID-23-00478-BN0] and received ethical approval from the Medical Research and Ethics Committee, Ministry of Health Malaysia. We conducted and reported this Delphi study following the guidance provided in the Conducting and REporting DElphi Studies (CREDES) checklist (see Additional File 1: Supplementary Table S1) [24, 25].
Study design
We conducted a two-round modified Delphi survey from March to June 2023, involving local and international panellists. The Delphi technique is a structured process that synthesises opinions of panellists to develop a group consensus [26, 27]. We used this technique to reduce bias because other group decision-making processes such as focus groups may be affected by the presence of individuals who dominate the discussion, or group pressure for compromise [28]. The Delphi technique addresses these limitations by using questionnaires to preserve anonymity of panellists, and providing controlled feedback in a multi-stage process which gives panellists the option to reassess their initial responses based on the aggregate group response [26, 29].
Study participants
Our Delphi panel comprised various stakeholders of medicines risk communication, namely (i) communicators and (ii) recipients of risk communication related to medicines. We included both local and international communicators to ensure a range of expertise and diverse perspectives. It has been suggested that diversity in the demographic characteristics and professional experience of Delphi panellists could be beneficial [30,31,32]. This allows consensus to be based on multiple independent sources of opinion.
Under the category of “communicators”, we included senders of risk communication such as representatives from NPRA and international regulatory agencies, the Malaysian Pharmacy Services Programme, pharmaceutical industry representatives, public health consultants, and medicine communication experts. The communicators were required to have a minimum of 3 years’ experience in risk communication. We included experts from international bodies with vast experience communicating the risks of medicines, such as the World Health Organisation (WHO), EMA, the International Society of Pharmacovigilance (ISoP), and TGA Australia. Communication experts from the Health Sciences Authority (HSA) Singapore, which shares cultural similarities with Malaysia, were also surveyed.
Academicians and healthcare professionals (general practitioners, medical officers, clinical specialists, and pharmacists) from both the public and private sectors in Malaysia who have received and read NPRA risk communication were included under the category of “recipients”. We excluded those who were not comfortable answering in English, and recipients who were not aware of NPRA risk communication.
The target minimum sample size in this study was set at 30 respondents based on previous Delphi studies with similar aims and recommendations that suggest an optimal range of 20 to 60 panellists for health science-related Delphi studies [25, 29, 33, 34]. We used purposive sampling and snowballing to recruit members of the Delphi panel. Individual invitation emails containing a participant information sheet and briefing video were sent to 53 panellists in February or March 2023, before the start of Round 1.
Participation in this research was entirely voluntary. We provided all panellists with information on the study aims, procedures, risks, benefits, and protection for individual privacy. Informed consent was obtained from all participants at the beginning of the questionnaire.
Questionnaire development
The traditional Delphi method involves idea gathering in Round 1 through open-ended questions [35]. However, we omitted this conventional first round of the study. Instead, we generated a list of strategies on enhancing risk communication through our previous research [19, 22, 36]. We identified an initial list of 43 strategies to enhance medicines risk communication in Malaysia through the findings of our survey [19], systematic review [22] and literature review. We performed face and content validity with a group of six experts on medicines risk communication from NPRA, the Ministry of Health Malaysia, and academia. The initial questionnaire containing 43 strategies was sent individually to the six experts, who were asked to provide qualitative feedback on each strategy. As an outcome of these validity tests, eight strategies were excluded because they could be merged under another strategy in the list. We also added two new strategies suggested by the experts. Thus, the list of strategies was refined to a total of 37 strategies [36], and categorised into six domains related to enhancing communication about the risks of medicines, as follows: (1) improve format and content; (2) implement educational programmes; (3) integrate risk communication information into practice; (4) increase use of technology; (5) evaluate effectiveness; and (6) increase collaboration (see Additional File 1: Supplementary Table S2 for details). We then pilot-tested the modified questionnaire among six members of the target population to finalise the Round 1 Delphi survey (see questionnaire in Additional File 2). The six members comprised two international communicators, one local communicator, and three recipients of Malaysian medicines risk communication. Feedback from the pilot test resulted in rewording several strategies and adding examples to enhance clarity. However, there was no change in the number of strategies included.
We designed and managed the questionnaire using Research Electronic Data Capture (REDCap) tools hosted at Universiti Malaya, Kuala Lumpur, Malaysia [37, 38]. REDCap is a secure, web-based software platform designed to support data capture for research studies, providing (1) an intuitive interface for validated data capture; (2) audit trails for tracking data manipulation and export procedures; (3) automated export procedures for seamless data downloads to common statistical packages; and (4) procedures for data integration and interoperability with external sources.
Delphi round 1
In Round 1, we sent emails containing the link for the web-based survey to 53 individual panellists who had agreed to join the study. Panellists were shown the list of 37 strategies to enhance NPRA risk communication and asked to prioritise each strategy using a 5-point Likert scale (1- not a priority, 2- low priority, 3- medium priority, 4- high priority, 5- highest priority) [36]. We also provided open-ended columns in each domain for panellists to suggested additional strategies which were not in the list. Reminder emails were sent to non-responders at days 7 and 14 following the initial survey distribution.
To allow for near-consensus strategies to be reconsidered in Round 2, we set a cut-off mean priority score of ≥ 3.75 in the first round [39, 40]. All strategies which achieved this score were included in the Round 2 questionnaire, along with any additional strategies proposed by the panel.
Delphi round 2
Among the 53 invited panellists, only 42 completed the survey in Round 1. All 42 panellists who completed Round 1 were sent an email invitation to participate in the Round 2 survey. Our Round 2 questionnaire (see Additional File 3) contained a list of 23 initial strategies and 11 new strategies proposed in Round 1. For each of the initial strategies, panellists were given feedback on the mean group response as well as their personal response from Round 1 (Fig. 1: sample questionnaire Round 2) and asked to prioritise each strategy again using the same 5-point Likert scale. Two reminder emails were sent to non-responders and we received 39 responses. We determined the criteria for consensus a priori as ≥ 75% of panellists [27, 41] giving the strategy a rating of 4 (high priority) or 5 (highest priority) on the 5-point Likert scale [36].
Data analysis
All data obtained was analysed using IBM SPSS version 20. We used descriptive statistics to present the demographic characteristics of panellists. We conducted thematic analysis to identify and categorise additional strategies suggested in Round 1 through open-ended columns.
From Round 2, we calculated the mean score of each strategy, and percentage of panellists who rated each strategy as 4 (high priority) or 5 (highest priority) on the 5-point Likert scale. We also assessed each strategy for disagreement among the panellists in both rounds. Disagreement is defined as ≥ 30% of participants rating a strategy 1 or 2 on the Likert scale, and ≥ 30% rating it 4 or 5 [42, 43].
We compared the standard deviations of priority scores for each strategy in both rounds to determine the extent of agreement. To assess the shift in opinion by the panellists between Round 1 and Round 2, we calculated the median degree of opinion change [44].
The data was also analysed separately according to subgroups. We used the Pearson Chi-squared test of independence to compare the priority rating between two subgroups: (i) communicators versus recipients, and (ii) local versus international panellists. Level of significance (α) was set at 0.05. Scatter plots were used to compare the difference of strategy prioritisation between the subgroups.
Results
Figure 2 illustrates the modified Delphi process employed in this study. A total of 48 strategies were assessed by our panellists (37 strategies identified through literature review and our previous research; 11 additional strategies from the panel in Round 1).
Table 1 shows the socio-demographic characteristics and response rates of our Delphi survey participants. A total of 42 stakeholders from nine countries participated in Round 1 of this survey, comprising 27 communicators (64.3%) and 15 recipients of medicines risk communication (35.7%). The average response rate for Round 1 was 79.2% (communicators 84.3%, recipients 71.4%) and 92.9% in Round 2 (communicators 96.3%, recipients 86.7%). Detailed characteristics of the panellists are listed in Additional File 1: Supplementary Table S3. More than 85% of our respondents had above 10 years work experience in their fields of expertise.
Selection of priority strategies
Following Round 1, 23 strategies with a mean priority score ≥ 3.75 (as shown in Additional File 1: Supplementary Table S2) were included in Round 2, along with 11 new strategies suggested by the panel (indicated with asterisks in Additional File 1: Supplementary Table S4) [36]. In Round 2, 21 out of the 34 strategies evaluated (61.8%) achieved consensus with ≥ 75% of panellists rating each strategy as 4 (high priority) or 5 (highest priority).
Figure 3 shows the mean priority scores for each domain in Round 1 and Round 2. Following Round 2, the top three domains were to (1) improve the format and content of risk communication, (2) increase the use of technology, and (3) increase collaboration to enhance risk communication about medicines. In Round 1, the domain “improve format and content” of risk communication contained nine strategies and ranked as the lowest priority domain. This domain emerged as top priority in Round 2, containing four strategies, and showed the greatest increase in mean priority score between the two rounds. The lower ranked strategies in Round 1 included to “establish an external medicines risk communication advisory board to review regulatory risk communication” and “increase use of narrative-style messages”. Many panellists commented that existing advisory boards on medicines safety may be able to review risk communication, but it may not be feasible to obtain the approval of an advisory board for each publication.
Figure 4 provides a summary of the list of strategies for enhancing risk communication about medicines in Malaysia as identified through our Delphi study, in order of priority for each domain. Please refer to Additional File 1: Supplementary Table S5 for the full list of priority strategies. Further details of the mean scores, percentage ratings and subgroup comparisons for each strategy are shown in Additional File 1: Supplementary Table S6.
Extent of agreement
Our analysis identified one strategy on which the panellists showed disagreement, namely the strategy “to offer incentives to pharmaceutical companies which maintain effective systems for medicines risk communication”. This strategy was rated 1 or 2 on the Likert scale by 33% of panellists, and rated 4 or 5 by another 33% of panellists (see Additional File 1: Supplementary Table S6).
We found that the standard deviations decreased from the first to second round for 21 out of the 23 strategies which were included in both rounds of this Delphi survey (see Additional File 1: Supplementary Table S6). As shown in Table 2, there was a minimal shift in opinion by the panellists between Round 1 and Round 2. The median degree of opinion change for most panellists was 0. None of the panellists had a median opinion change of more than 1. We found no significant difference between communicators and recipients with regards to the median degree of opinion change [ χ2(1, N=39) = 0.315; p = 0.575].
Subgroup analysis
Figure 5 illustrates our subgroup analysis comparing the mean priority scores for each strategy in Round 2 between (i) communicators versus recipients [Fig. 5(a)]; and (ii) local versus international panellists [Fig. 5(b)] (see Additional File 1: Supplementary Table S7 for details). We found that 16 strategies fell within the high priority area for each comparison group, as indicated by the blue dots in Fig. 5. All these strategies were among the 21 strategies which achieved consensus through our Delphi process (Fig. 4).
There was a statistically significant difference in rating between subgroups for two strategies. First, local panellists gave significantly higher ratings compared to international panellists for the strategy “to increase outreach of educational programmes” [χ2(1, N = 39) = 6.4; p = 0.040] [Fig. 5(b)].
Second, priority ratings for the strategy “to offer incentives to pharmaceutical companies which maintain effective systems for medicines risk communication” were significantly higher among recipients compared to communicators [χ2(1, N= 39) = 10.1; p = 0.039] [Fig. 5(a)] and among local versus international panellists [χ2(1, N= 39) = 14.3; p = 0.007] [Fig. 5(b)].
Discussion
Our Delphi study successfully established a consensus on the priority strategies to enhance risk communication about medicines by Malaysian regulators. We obtained a list of 21 priority strategies based on the opinions of medicines risk communication experts and recipients. The domains which obtained the highest mean scores, thus rated as domains to be prioritised are to “improve the format and content of risk communication”, “increase the use of technology”, and “increase collaboration to enhance risk communication about medicines”. Meanwhile, the top three highest rated strategies were to “create more concise communication”, “increase collaboration with professional associations”, and “incorporate medicines safety information in training programmes for newly qualified healthcare professionals”.
The strategy to produce concise communication with increased use of infographics fits with the current preferences of audiences for fast and succinct information [45]. Previous studies have shown that the use of visuals helps recipients understand complex information more quickly compared to text alone [46]. This is supported by several theories including the cognitive theory of multimedia learning [47], and the dual coding theory [48]. The design of effective infographics should involve highlighting essential information, reducing extraneous information, using space effectively, and inserting appealing graphics [47, 49].
Collaboration is essential to produce an effective system for communicating the risks of medicines. In Round 2 of this Delphi study, we found that seven of the eight strategies related to collaboration achieved consensus to be prioritised. These findings highlight the importance of collaboration between regulators and various stakeholders to improve content and widen dissemination of the risk communication. Previous studies and guidelines have established that collaboration between regulators, healthcare professionals, patients, the pharmaceutical industry and policy makers is needed to increase communication effectiveness [1, 14].
Panellists in this Delphi study also prioritised the incorporation of medicines safety information in training programmes for newly qualified healthcare professionals. The integration of such information should be made mandatory in orientation programmes and repeated at regular intervals to ensure all healthcare professionals are aware of the latest sources of medicines safety information [50]. Another high-priority strategy was to develop a module on medicines safety for undergraduate health science courses. A team of experts in medicines safety from the WHO and ISoP published a curriculum for teaching pharmacovigilance in 2014 [51]. However, this curriculum needs to be revised to reflect the evolvement of pharmacovigilance over the past decade in terms of scientific, regulatory and technological developments [51]. Additionally, globalization has led to the increased availability of effective but potentially harmful medicinal products across various countries. This situation requires that healthcare workers from multiple disciplines have updated knowledge of pharmacovigilance. Thus, pharmacovigilance should be included as a standard module in health science courses worldwide [51].
Among the 48 strategies assessed by our Delphi panel, 27 strategies were dropped. The domain “improve format and content” showed the largest increase in mean score from Round 1 to Round 2, after six lower ranked strategies were excluded following the first round. All four strategies included in this domain for Round 2 emerged as high-priority, indicating the importance of creating concise, multi-lingual communication using a standardised format, and being transparent in communicating uncertainties. However, some interesting strategies were not rated as high priority in our Delphi study. For example, the strategies to “leverage artificial intelligence tools to make searching easier and generate more interactive communication” and “use a mobile phone application for medicines risk communication” did not meet the criteria to be prioritised. This was surprising given the rapid development in generative artificial intelligence that has made the use of chatbots and machine learning more mainstream [52]. Based on the results of our study, the current focus should be on improving the format of risk communication, enhancing the regulatory agency website, improving training on pharmacovigilance particularly for doctors and pharmacists, and increasing collaboration with various stakeholders. Globally, we observe an increase in the use of artificial intelligence to communicate the risks associated with medicines [53]. However, our Delphi findings indicate that Malaysian regulators should prioritise the basic requirements of effective risk communication, such as format, outreach and training.
Our Delphi study revealed differing opinions among subgroups. For instance, regarding the strategy “to offer incentives to pharmaceutical companies which maintain effective systems for medicines risk communication”, there were notable differences. Recipients rated this suggestion as higher priority compared to communicators, and local panellists rated it higher than international panellists. Additionally, among all strategies, the strategy to offer incentives was the only strategy where there was significant disagreement among panellists. Many regulators and international panellists rated this strategy as low priority. We postulate that these panellists believe that pharmaceutical companies need to strike a balance between expecting incentives, and performing their duty to maintain competent risk communication systems [54]. Local panellists also gave higher ratings than international panellists for the strategy “to increase outreach of educational programmes (for example to private sector healthcare professionals)”. This may be because local panellists were more aware of the scenario in Malaysia, where until recently, educational programmes organised by the public sector did not routinely involve participants from the private sector. These differences in opinion between panellists emphasise the need for a standardised list of priority strategies developed by experts and multiple stakeholders.
Although our panellists were asked to consider the strategies in the context of Malaysian regulatory risk communication, the list of priority strategies also potentially serves as a useful guide for other countries aiming to improve their risk communication about medicines. Almost all high-income countries have robust pharmacovigilance systems in terms of monitoring adverse drug reactions [13]. However, establishing effective systems for risk communication about medicines remains a challenge for most countries [7, 11], particularly due to budget constraints in low- or middle-income countries [13]. Individual countries need to develop specific strategies which help regulators, manufacturers and healthcare professionals overcome the challenges of risk communication, including misinformation and public mistrust [55].
This study adds a suite of implementable strategies produced by a group of medicines risk communication experts and stakeholders. The impact of this study will be seen in terms of increased patient safety and cost-savings. Following this study, clear steps could be taken to improve the quality of risk communication and educational material in Malaysia, ensuring both healthcare professionals and patients are as well-informed as possible. The aim is to go beyond diffusion of information, creating a two-way process allowing patients to use the information effectively and promote empowerment [1]. Implementation of each strategy must be followed with evaluation of its impact, for example on prescribing behaviour, knowledge, or ADR reporting rate. This evaluation will provide valuable evidence to amend and improve the strategies [1].
Strengths and limitations
We used the modified Delphi technique to reduce bias due to dominant personalities, and allow consensus building between experts from various geographical locations or time zones. To ensure we considered all relevant strategies, panellists were allowed to suggest additional strategies in Round 1 via free-text comments. There was a low median degree of change in opinion, indicating stability as the majority of panellists did not change their opinion between the two rounds. Another strength of our study is the inclusion of communication experts from nine countries as well as recipients who are familiar with the current Malaysian regulatory risk communication. Our response rates ranged from 71 to 96%, which further strengthens the study.
Our study has several limitations. First, we presented a list of strategies to the panel rather than conducting the traditional open-ended first round. This was done to ensure the strategies were relevant to the Malaysian regulatory context but could potentially have stifled the generation of ideas by panellists. To overcome this limitation, panellists were invited to suggest additional strategies in Round 1. However, we found that most new suggestions were not given a high priority rating. Only two new strategies achieved consensus, namely collaboration with international bodies, and communicating transparently. This indicates that the initial list of strategies could be considered comprehensive. Second, priority strategies were identified but not ranked by the panellists. Considering the varied backgrounds of our panellists, we did not require the strategies to be ranked as this would require in-depth knowledge of the current Malaysian risk communication. The scope of this paper also does not encompass detailed guidance on how these strategies could be implemented. Participants were not asked to consider the feasibility of implementation, or consider barriers such as cost and manpower. While we looked at strategies to enhance risk communication by Malaysian regulators, some of the strategies fall under the jurisdiction of other authorities, such as policy makers and academicians. Our study aimed to obtain the broad perspective of stakeholders on priority strategies. Following this Delphi survey, we will conduct an expert panel discussion to develop a strategic plan for enhancing risk communication about medicines in Malaysia. Third, as medicines risk communication is an ever-developing field, the strategies identified are deemed to be of highest priority at the time the study was undertaken. This list of strategies needs to be reviewed and updated periodically, for example every five years. Fourth, while our study focused on doctors and pharmacists as they are currently the main recipients of Malaysian medicines risk communication, input from other stakeholders such as nurses, dentists, and consumers may have added to the range of strategies. Further studies are being planned to evalute the implementation of strategies and involve other stakeholders. Fifth, our Delphi panel was restricted to those comfortable answering in the English language, which may limit the generalisability of our study findings [56]. Nevertheless, our study offers an important list of priority strategies produced by experts, as a guide for enhancing medicines risk communication in Malaysia and other countries with growing pharmacovigilance systems.
Future research
Future studies should involve stakeholders other than doctors and pharmacists, especially nurses and consumers. We need to design studies to evaluate each of the strategies implemented, for example via feedback surveys or the analysis of adverse drug reaction databases. Further study is also required on the barriers to implementation of strategies. Collaborative research should be conducted with regulatory authorities from other countries with similar cultures or economic status, to accelerate the progress of risk communication systems.
Conclusions
Combining the views of Malaysian and international medicines communication experts and also recipients of Malaysian regulatory risk communication, our Delphi study produced a consensus-based list of priority strategies for enhancing risk communication about medicines in Malaysia. This list was used to develop a strategic plan for implementation by the Malaysian regulatory authority, which would also be potentially adaptable to other countries with developing pharmacovigilance systems. The strategies identified as of top priority were to create more concise communication, increase collaboration with professional associations, and incorporate medicines safety information in training programmes for newly qualified healthcare professionals. The existence of different views between communicators and recipients, and also between local and international panellists, highlights the importance of involving multiple stakeholders in research.
Data availability
All data generated or analysed during this study are included in this published article and its electronic supplementary material.
References
Bahri P, Bowring G, Edwards BD, Anton C, Aronson JK, Caro-Rojas A, et al. Communicating for the safe use of Medicines: progress and directions for the 2020s promoted by the Special Interest Group of the International Society of Pharmacovigilance. Drug Saf. 2023. https://doi.org/10.1007/s40264-023-01285-5.
Bahri P, Dodoo AN, Edwards BD, Edwards IR, Fermont I, Hagemann U, et al. The ISoP CommSIG for improving Medicinal product risk communication: a New Special Interest Group of the International Society of Pharmacovigilance. Drug Saf. 2015. https://doi.org/10.1007/s40264-015-0301-0.
Bahri P, Harrison-Woolrych M. How to improve communication for the safe use of Medicines? Discussions on Social Marketing and patient-tailored approaches at the annual meetings of the WHO Programme for International Drug Monitoring. Drug Saf. 2012. https://doi.org/10.1007/BF03261993.
Bahri P, Harrison-Woolrych M. Focusing on risk communication about medicines. Why now? Drug Saf. 2012. https://doi.org/10.1007/BF03261984.
Hartigan-Go K. Challenges of drug risk communications in the Philippines. Drug Saf. 2012. https://doi.org/10.1007/BF03261987.
Edwards IR, Hugman B. The challenge of effectively communicating risk-benefit information. Drug Saf. 1997. https://doi.org/10.2165/00002018-199717040-00002.
Bahri P, editor. Communicating about risks and safe use of medicines: Real life and applied research. Singapore: Adis 2020; https://doi.org/10.1007/978-981-15-3013-5
Tuccori M, Convertino I, Ferraro S, Cappello E, Valdiserra G, Focosi D, et al. The impact of the COVID-19 infodemic on drug-utilization behaviors: implications for Pharmacovigilance. Drug Saf. 2020. https://doi.org/10.1007/s40264-020-00965-w.
European Union. Directive 2001/83/EC of the European parliament and of the council of 6 November 2001 on the community code relating to medicinal products for human use as amended. Off J Eur Commun L 311:67–128. Amended by: European Union (31 Dec 2010). Directive 2010/84/EU of the European parliament and of the council of 15 December 2010 amending, as regards pharmacovigilance Directive 2011/83/EC. Official Journal of the European Union. 2010; https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX:32001L0083 [Accessed 7 July 2024].
Uppsala Monitoring Centre. Glossary of pharmacovigilance terms. 2018; https://www.who-umc.org [Accessed 7 July 2024].
Bhasale AL, Sarpatwari A, De Bruin ML, Lexchin J, Lopert R, Bahri P, et al. Postmarket Safety Communication for Protection of Public Health: a comparison of Regulatory Policy in Australia, Canada, the European Union, and the United States. Clin Pharmacol Ther. 2021. https://doi.org/10.1002/cpt.2010.
NPRA. Malaysian Guidelines on Good Pharmacovigilance Practices (GVP) for Product Registration Holders (PRHs). 2021; https://www.npra.gov.my/index.php/en/health-professionals/reporting-adr.html [Accessed 6 July 2024].
Khan MAA, Hamid S, Babar Z-U-D. Pharmacovigilance in High-Income countries: current developments and a review of literature. Pharmacy. 2023. https://doi.org/10.3390/pharmacy11010010.
WHO. Risk Communication Strategy for Public Health Emergencies in the WHO South-East Asia Region. 2019–2023. New Delhi: World Health Organization. Regional Office for South-East Asia 2019; https://apps.who.int/iris/handle/10665/326853 [Accessed 19 February 2023].
EMA. Guideline on good pharmacovigilance practices (GVP) - Module XVI – Risk minimisation measures: selection of tools and effectiveness indicators (Rev 3) 2021. http://www.jfda.jo/Download/JPC/TheGoodPharmacovigilancePracticev2.pdf [Accessed 24 February 2023].
Bahri P, Rägo L. CIOMS Guide to Vaccine Safety communication – executive summary. Vaccine. 2019. https://doi.org/10.1016/j.vaccine.2018.11.082.
US FDA. FDA Strategic Plan for Risk Communication and Health Literacy. 2017. https://www.fda.gov/about-fda/reports/strategic-plan-risk-communication [Accessed 2 February 2023].
Arora P, Pandey N, National Risk Communication. Plan 2016. http://ncdc.gov.in/writereaddata/mainlinkfile/File593.pdf [Accessed 2 February 2023].
Panickar R, Aziz Z, Kamarulzaman A. Enhancing medication risk communication in developing countries: a cross-sectional survey among doctors and pharmacists in Malaysia. BMC Public Health. 2022. https://doi.org/10.1186/s12889-022-13703-x.
Tiong JJL, Mai CW, Gan PW, Johnson J, Mak VSL. Separation of prescribing and dispensing in Malaysia: the history and challenges. Int J Pharm Pract. 2016. https://doi.org/10.1111/ijpp.12244.
Panickar R, Wo WK, Ali NM, Tang MM, Ramanathan GRL, Kamarulzaman A, et al. Allopurinol-induced severe cutaneous adverse drug reactions: risk minimization measures in Malaysia. Pharmacoepidemiol Drug Saf. 2020. https://doi.org/10.1002/pds.5033.
Panickar R, Aziz Z, Mohd Sani N, Kamarulzaman A. The use of technology in vaccine safety communication: a systematic review of randomised controlled trials. Patient Educ Couns. 2023. https://doi.org/10.1016/j.pec.2023.107707.
Ahmad D. Enhancing sustainability in healthcare delivery-A challenge to the New Malaysia. Malaysian J Med Sci. 2019. https://doi.org/10.21315/mjms2019.26.1.1.
Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and REporting DElphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017. https://doi.org/10.1177/0269216317690685.
Muhl C, Mulligan K, Bayoumi I, Ashcroft R, Godfrey C. Establishing internationally accepted conceptual and operational definitions of social prescribing through expert consensus: a Delphi study. BMJ Open. 2023. https://doi.org/10.1136/bmjopen-2022-070184.
Dalkey N. An experimental study of group opinion: the Delphi method. Futures. 1969. https://doi.org/10.1016/S0016-3287(69)80025-X.
Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014. https://doi.org/10.1016/j.jclinepi.2013.12.002.
Foth T, Efstathiou N, Vanderspank-Wright B, Ufholz LA, Dütthorn N, Zimansky M, et al. The use of Delphi and Nominal Group Technique in nursing education: a review. Int J Nurs Stud. 2016. https://doi.org/10.1016/j.ijnurstu.2016.04.015.
Taylor E. We agree, don’t we? The Delphi Method for Health Environments Research. Health Environ Res Des J. 2020. https://doi.org/10.1177/1937586719887709.
Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003. https://doi.org/10.1046/j.1365-2648.2003.02537.x.
Barrios M, Guilera G, Nuño L, Gómez-Benito J. Consensus in the Delphi method: what makes a decision change? Technol Forecast Soc Change. 2021. https://doi.org/10.1016/j.techfore.2020.120484.
Hussler C, Muller P, Rond P. Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy. Technol Forecast Soc Change. 2011. https://doi.org/10.1016/j.techfore.2011.07.008.
Nasa P, Jain R, Juneja D. Delphi methodology in healthcare research: how to decide its appropriateness. World J Methodol. 2021. https://doi.org/10.5662/wjm.v11.i4.116.
Fakha A, de Boer B, van Achterberg T, Hamers J, Verbeek H. Fostering the implementation of transitional care innovations for older persons: prioritizing the influencing key factors using a modified Delphi technique. BMC Geriatr. 2022. https://doi.org/10.1186/s12877-021-02672-2.
Keeney S, Mres BA, Hasson F, Msc BA, Dip PG, Mckenna H, et al. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006. https://doi.org/10.1111/j.1365-2648.2006.03716.x.
Panickar R, Aziz Z, Teo CH, Kamarulzaman A. Prioritising Strategies to Enhance Medication Risk Communication in Malaysia: A Delphi Survey Among International Experts [Abstract]. In: Proceedings of the 22nd ISoP Annual Meeting; 2023 Nov 6–9; Bali, Indonesia. Drug Saf. 2023; https://doi.org/10.1007/s40264-023-01350-z
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inf. 2009. https://doi.org/10.1016/j.jbi.2008.08.010.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inf. 2019. https://doi.org/10.1016/j.jbi.2019.103208.
Butler MM, Meehan TC, Kemple M, Drennan J, Treacy M, Johnson M. Identifying research priorities for midwifery in Ireland. Midwifery. 2009. https://doi.org/10.1016/j.midw.2007.08.004.
Broomfield D, Humphris GM. Using the Delphi technique to identify the cancer education requirements of general practitioners. Med Educ. 2001. https://doi.org/10.1111/j.1365-2923.2001.01022.x.
Jünger S, Payne S, Brearley S, Ploenes V, Radbruch L. Consensus building in palliative care: a Europe-wide Delphi study on common understandings and conceptual differences. J Pain Symptom Manage. 2012. https://doi.org/10.1016/j.jpainsymman.2011.09.009.
Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. Br Med J. 2006. https://doi.org/10.1136/bmj.38926.629329.AE.
Campbell SM, Cantrill JA, Roberts D. Prescribing indicators for UK general practice: Delphi consultation study. Br Med J. 2000. https://doi.org/10.1136/bmj.321.7258.425.
Meijering J, Tobi H. The effect of controlled opinion feedback on Delphi features: mixed messages from a real-world Delphi experiment. Technol Forecast Soc Change. 2016. https://doi.org/10.1016/j.techfore.2015.11.008.
Kain NA, Jardine CG. Keep it short and sweet: improving risk communication to family physicians during public health crises. Can Fam Physician. 2020;66:e99–106.
Spicer JO, Coleman CG. Creating effective infographics and visual abstracts to Disseminate Research and Facilitate Medical Education on Social Media. Clin Infect Dis. 2022. https://doi.org/10.1093/cid/ciac058.
Mayer RE. Applying the Science of Learning: evidence-based principles for the design of Multimedia instruction. Am Psychol. 2008. https://doi.org/10.1037/0003-066X.63.8.760.
Clark JM, Paivio A. Dual Coding Theory and Education. Educ Psychol Rev. 1991. https://doi.org/10.1007/BF01320076.
Mayer RE. Incorporating motivation into multimedia learning. Learn Instr. 2014. https://doi.org/10.1016/j.learninstruc.2013.04.003.
Persechino B, Fontana L, Buresti G, Rondinone BM, Laurano P, Imbriani M, et al. Professional activity, information demands, training and updating needs of occupational medicine physicians in Italy: National survey. Int J Occup Med Environ Health. 2016. https://doi.org/10.13075/ijomeh.1896.00736.
Beckmann J, Hagemann U, Bahri P, Bate A, Boyd IW, Dal Pan GJ, et al. Teaching pharmacovigilance: the WHO-ISoP core elements of a Comprehensive Modular Curriculum. Drug Saf. 2014. https://doi.org/10.1007/s40264-014-0216-1.
Wang H, Ding YJ, Luo Y. Future of ChatGPT in Pharmacovigilance. Drug Saf. 2023. https://doi.org/10.1007/s40264-023-01315-2.
Neuhauser L, Kreps GL, Morrison K, Athanasoulis M, Kirienko N, Van Brunt D. Using design science and artificial intelligence to improve health communication: ChronologyMD case example. Patient Educ Couns. 2013. https://doi.org/10.1016/j.pec.2013.04.006.
Santoro M, Shanklin R. Human rights obligations of drug companies. J Hum Rights. 2020. https://doi.org/10.1080/14754835.2020.1820315.
Zuluaga-Arias HP, Alkhakany M, Younus MM, Sefiani H, Caro-Rojas A, Al-Zubiedi S, et al. Impact of risk communication on patient’s safety during the pandemic. Ther Adv Drug Saf. 2023. https://doi.org/10.1177/20420986231159752.
Frayne SM, Bums RB, Hardt EJ, Rosen AK, Moskowitz MA. The exclusion of non-english-speaking persons from Research. J Gen Intern Med. 1996. https://doi.org/10.1007/BF02603484.
Acknowledgements
We would like to thank the Director General of Health Malaysia and the NPRA pharmacovigilance team for supporting this study. We are very grateful to all experts and panellists who participated in this Delphi study. Parts of this study and not the entire content were presented as a poster during the International Society of Pharmacovigilance 22nd Annual Meeting in November 2023.
Funding
This research did not receive funding from any agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
R.P. conceived and designed this study. C.H.T. advised on the study design, recruitment of participants, questionnaire development and data analysis. R.P. developed and conducted the surveys, collected, analysed and interpreted the data, and drafted the manuscript. Z.A., C.H.T. and A.K. reviewed the manuscript for important intellectual content. Z.A. critically revised the manuscript and provided final approval of the version to be submitted. All authors read and approved the final manuscript for publication.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study is registered under the National Institute of Health and received ethics approval from the Medical Research and Ethics Committee, Ministry of Health Malaysia, under approval number NMRR ID-23-00478-BN0, dated 10 April 2023. All methods were carried out in accordance with relevant guidelines and regulations. We performed the study is in accordance with the principles of the Declaration of Helsinki. Participation in this research was entirely voluntary. We provided all participants with information on the study aims, procedures, risks, benefits, and protection for individual privacy. Written informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable. No personal information is disclosed and subjects are not identified individually in the findings of this study.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Panickar, R., Aziz, Z., Teo, C.H. et al. Strategies to enhance risk communication about medicines in Malaysia: a Delphi study among multinational experts. BMC Health Serv Res 24, 1019 (2024). https://doi.org/10.1186/s12913-024-11476-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-024-11476-0