Skip to main content
Download PDF

Trends in the development process of clinical practice guidelines: a questionnaire survey for the guideline development groups in Japan

BMC Health Services Research volume 22, Article number: 94 (2022) Cite this article

Abstract

Background

Clinical practice guidelines (CPGs) are representative methods for promoting healthcare standardization and improving its quality. Previous studies on the CPG (published by 2006) development process in Japan reported that the involvement of experts and patients, efficient evidence collection and appraisal, and paucity of evidence on Japanese patients should be improved for the efficient CPG development. This study aimed to clarify the trends of CPG development process in Japan, focusing on the involvement of experts and patients, efficient evidence collection and appraisal, and paucity of Japanese evidence.

Methods

A cross-sectional questionnaire survey was conducted for CPG development groups to collect information on the development activities of the CPGs published from 2012 to 2019. These CPGs were identified from the Japanese guideline clearinghouse. The questionnaire included the questions on composing the group, securing funding sources, collecting and appraising the research evidence, and the difficulties in the CPG development process. The questionnaires were distributed to the chairpersons of the CPG development groups through postal mail from November 2020 to January 2021. Combining the data from the current survey with those of previous studies reporting the development process of CPGs published by 2011, we analyzed the trend in the CPG development process.

Results

Of the total 265 CPGs included in the analysis, 164 (response rate: 41.4%) were from the current survey and 101 (response rate: 44.5%) were from previous studies. Among these, 40 (15.1%) were published by 2005, 47 (17.7%) in 2006–2010, 77 (29.1%) in 2011–2015, and 101 (38.1%) in 2016–2019. The proportion of CPGs involving methodologists did not increase through the publication periods. The proportion of CPGs involving patients almost doubled from the first period (15.9%) to the fourth period (32.4%). The yield rates of the articles did not change through the publication periods. The difficulty in “Coping with the paucity of Japanese evidence” has been improving consistently (69.2% in the first period to 37.4% in the fourth period).

Conclusions

Our results suggest the need for methodological improvement in the efficient collection and appraisal of evidence and in the system assigning experts to the CPG development groups.

Peer Review reports

Background

Clinical practice guidelines (CPGs) are statements that include recommendations based on a systematic review of evidence and an assessment of the benefits and harms of alternative care options in order to assist the decision making of practitioners and patients [1, 2]. CPGs are representative methods for promoting the standardization of healthcare and improving its quality. In October 2021, more than 29,000 articles indexed as “practice guideline” for publication type were listed in PubMed. In Japan, the Ministry of Health, Labour and Welfare has encouraged academic societies to develop CPG for major diseases using public research funds since 2000. Currently, academic societies and research groups are involved in developing and managing CPGs, and approximately 60 CPGs, including newly developed and revised CPGs, are being published every year.

Numerous development manuals and more than 40 appraisal tools have been published to ensure the quality of CPGs [3, 4]. The general steps involved in the development of CPG are as follows: i) identifying and refining the CPG subject area, ii) running development groups, iii) identifying and assessing the research evidence, iv) translating the evidence into CPGs, and v) reviewing and updating the CPGs [5]. Because the evidence and resources that can be used differ among the CPG developers, the actual CPG development processes may vary substantially [2]. Therefore, information regarding the methods used and the difficulties encountered in the actual development processes could help in improving the environment (available methodological guidance, tools, support systems, etc.) of CPG development process. Additionally, given the changing environments of CPG development, the trends of the CPG development process can provide valuable information. The descriptions of the methods and processes of CPG development are usually included in the CPGs, and there are some case reports [6, 7] and cross-sectional surveys [8,9,10] on the actual CPG development processes. These reports show only a snapshot of the development process and not the trends of the methods used by CPG developers. Some previous studies have reported the trends of the CPG development through conducting systematic reviews [11,12,13]. However, it is not possible to obtain information on the detail of ingenuity or difficulties in the CPG development process from the description in published CPGs only.

Based on the questionnaire surveys conducted on the development groups of the CPGs published by 2006 [14,15,16], Hasegawa revealed the problems in the CPG development process in Japan. These problems were associated with the involvement of experts (e.g., epidemiologists, librarians, or health economists) and patients, efficient evidence collection and appraisal in systematic review, and paucity of evidence on Japanese patients [16]. The US Institute of Medicine pointed out the importance of expert and patient involvement in the “Guideline Development Group Composition” for developing trustworthy CPGs [2]. Participation of patients as stakeholders in the CPG development process is expected to enhance the validity and usefulness of published CPGs [17]. Because conducting systematic reviews can be a time-consuming and cost- and resource-intensive task, the efficacy of systematic reviews becomes especially problematic when the CPG developers make recommendations expeditiously [18]. CPGs are developed to support patients and practitioners in each country or region based on the evidence gathered from around the world, and the evidence used in the CPGs may often not include patients of interest of the CPG developers. These problems were revealed on examination of the CPG development processes in Japan, but these could be common problems for CPG developers worldwide. Hasegawa et al. conducted a questionnaire survey on development groups of the CPG published by 2011, addressing the CPG development process. Their questionnaire and data can be used in this study for the trend analysis of the methods of CPG development and the difficulties encountered by the CPG development groups [19].

Methods

Aim

This study aimed to clarify the trends of CPGs development process in Japan, focusing on the involvement of experts and patients, efficient evidence collection and appraisal in systematic review, and paucity of evidence on Japanese patients.

Study design and participants

A cross-sectional questionnaire survey conducted for Japanese CPG development groups was used to collect information on the development activities of CPGs published from 2012 to 2019.

To identify Japanese CPGs, we used a Japanese guideline clearinghouse managed by the Toho University Medical Media Center [20], which collected all CPGs published in Japan. The CPGs were selected based on the following criteria: (1) the title includes the terms “guideline,” “guidance,” or “guide”; (2) the methodology describes the CPG development process based on existing evidence or newly conducted systematic reviews; and (3) the theme relates to clinical practice and not to topics such as medical ethics and animal experimentation. The CPGs whose target readers were patients were excluded from this study.

The survey was conducted through postal mail, targeting chairpersons of the CPGs identified from the Japanese guideline clearinghouse, from November 2020 to January 2021. The bibliographic information about the CPG for which we requested to answer were enclosed with the questionnaire to minimize the potential discrepancies between CPGs participants answered and those we intended. We also sent reminders in December 2020 to the unresponsive chairpersons. We retrieved information on the chairpersons from the descriptions in the CPGs. To ensure continuity in the analysis, the questionnaire was similar to that of the previous studies regarding the questions on a) the processes for composing the development group (total number of members and the experts and patients involved), and collecting and appraising the research evidence, and b) the difficulties in the CPG development processes [14,15,16, 19]. The terminology of these items was based on a Japanese guidebook for CPG development [21] and the translated Japanese version of the original Appraisal of Guidelines for Research and Evaluation (AGREE) instrument [22, 23].

The Ethics Committee of Toho University School of Medicine stated that this study was not applicable for ethical review under the Japanese regulations (No. A20064). All participants were informed about the objective of the research and the policy for keeping their data confidential and anonymous in the survey. There is no published protocol of this study. For the reporting, we followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline for observational studies [24].

Measurements

Information about the publication year, development group, and versions of the CPGs were collected from the descriptions in the CPGs. The publication years of the CPG were divided into four periods: by 2005, from 2006 to 2010, from 2011 to 2015, and from 2016 to 2019. Development groups were grouped into three categories: research group, research group plus academic society, and academic society. “Research groups” were temporary groups for conducting research on specific themes. In Japan, a CPG development handbook explaining the methodology related to MINDS, a business arm associated with the CPGs of the Japan Council for Quality Care, has served as the basis for the development of CPGs for a considerable time [7, 25]. Furthermore, it encouraged the CPG developers to conduct an evidence appraisal using abstract forms consisting of bibliographic information, structured summaries, and comments from abstractors. Therefore, evidence searching, evidence appraising with abstract forms, and evidence citing in completed CPGs were set as the process of evidence collection and appraisal in the questionnaire. The yield rates were calculated by dividing the number of appraised articles by the number of obtained articles and the number of cited articles by the number of obtained articles through the search.

Data analysis

We used data of the CPGs published in 2012–2019 from the current survey and those published by 2011 from previous studies [14,15,16, 19]. To confirm whether the challenges of CPG development suggested in the previous study [16] have been resolved, we analyzed the data using the Mantel-Haenszel test for trend for categorical variables and the Jonckheere-Terpstra test for continuous variables. All data were analyzed using Statistical Product and Service Solutions software, version 25.0 (IBM), and P-values < 0.05 were considered statistically significant.

Results

CPG selection

Figure 1 shows the flowchart of the selection of CPGs in this study. In this study, 420 CPGs were retrieved from the Japanese guideline clearinghouse, of which 14 CPGs for patients were excluded. The questionnaires were distributed to the chairpersons of 406 CPG development groups. The response rate was 41.4% (168/406), and four CPGs were excluded because the chairpersons of these CPG development groups answered for versions of CPG different from those expected by us. The response rate of previous studies was 44.5% (101/227). Finally, 265 CPGs were included in the analysis, of which 164 (61.9%) were from the Japanese guideline clearinghouse and 101 (38.1%) were from previous studies [14,15,16, 19].

Fig. 1
figure 1

Flowchart of the selection of 265 CPGs from Japanese guideline clearinghouse and previous studies. We included data of the CPGs published in 2012–2019 from the current survey and those published in 2011 from previous studies [14,15,16, 19]. Of the 168 CPGs, 4 were excluded because the respondents answered for versions of CPGs different from those expected by us. Of the total 265 CPGs, 164 were from the current survey and 101 were from previous studies [14,15,16, 19]. Abbreviations: CPG, clinical practice guideline

Full size image

The characteristics of the 265 included CPGs are listed in Table 1. Among these, 40 (15.1%) were published by 2005, 47 (17.7%) in 2006–2010, 77 (29.1%) in 2011–2015, and 101 (38.1%) in 2016–2019. The proportion of CPG developed by academic societies has increased from 45.0% in the first period (by 2005) to 86.1% in the fourth period (2016–2019).

Table 1 Characteristics of the CPGs included in this study (N = 265)
Full size table

Expert and patient involvement in the guideline development groups

Table 2 shows the results regarding the group members and collaborations of the CPG development process in each publication period. The total number of members involved in CPG development has been increasing. The mean (standard deviation: SD) number of members in the first, second, third, and fourth publication period was 25.5 (14.4), 23.9 (18.2), 26.5 (30.3), and 37.2 (36.2), respectively. The mean (range) numbers were 24.3 (0 to 183) in Specialists for the theme of CPGs, 3.0 (0 to 61) in General practitioners engaged in medical practice of the theme of CPGs, and 1.1 (0 to 23) in Comedies, respectively. The proportion of CPGs involving methodologists (epidemiologists, statisticians, evidence-based medicine experts, experts in the guideline development, or librarians) and health economists did not increase through the publication periods. The proportion of CPGs involving patients almost doubled from the first period (12.5%) to the fourth period (32.4%). Additionally, collaboration between the CPG development groups and patient groups showed an increasing trend from 5.4% in the first period to 21.2% in the fourth period.

Table 2 Total number of members and collaborations with other organizations (N = 265)
Full size table

Evidence collection and appraisal

As shown in Table 3, the activities for evidence collection and appraisal changed slightly. Regarding the databases for searching evidence, PubMed was the most used database by more than 90% of the CPG development groups, followed by Ichushi, a Japanese database managed by the Japan Medical Abstracts Society, which was used by about 80% of the groups in all the publication periods. The proportion of the CPG development groups using JMEDplus in the evidence search, another database listing Japanese articles, showed a decreasing trend. There were no trends observed for the number of articles searched, appraised, and cited in the CPG. Additionally, the yield rates of the articles did not show any improvement trends. While the proportion of the CPG involving two or more reviewers for citing articles showed a consistently increasing trend (from 43.3% in the first period [by 2005] to 78.7% in the fourth period [2016–2019]), those for searching and appraising articles showed no observable trend.

Table 3 Evidence collection and appraisal process (N = 265)
Full size table

Difficulties in the guideline development process

Table 4 presents the difficulties encountered in the CPG development process. The highest difficulty was observed in the process of “handling with parts without evidence” (65.7%), followed by “evaluating the evidence” (60.6%), “editing” (51.5%), “searching for the research evidence” (47.5%), “composing development group” (45.5%), and “coping with the paucity of Japanese evidence” (37.4%) in the fourth publication period. “Coping with the paucity of Japanese evidence” has been improving consistently. Difficulty in the process of “composing development group” increased from the first publication period (by 2005) to the fourth (2016–2019). While there were no observable trends in the number and yield rate of the articles (Table 3), the CPG development groups showed an increasing trend of having difficulty in the process of “searching for the research evidence”.

Table 4 Difficulties in the clinical practice guidelines development process (N = 265)
Full size table

Discussion

This survey involving CPG development groups in Japan revealed that among the problems noted in CPG development in a previous study [16], there has been significant improvement in patient involvement and coping with the paucity of Japanese evidence, but not in expert involvement, efficiency of evidence collection and appraisal.

Patient involvement has increased across many fields in Japan, such as clinical practice, health policy making, and clinical research [26,27,28]. With respect to CPG, the Japanese CPG development handbook published in 2007 [25] served as the basis for CPG development in Japan for a considerable time [7]. It suggested that patient involvement was “desirable” in the CPG development process, but the manual, which was the updated version of that handbook in 2017, emphasized the importance of patient involvement by calling it “essential” [29]. The efforts in the dissemination of the importance of patient involvement might have enhance the validity and usefulness of the CPGs through improving patient involvement in the CPG development process.

Basing on the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach [30], the manual disseminated the assessment methods of “indirectness,” referring to the difference between the population, interventions, comparisons, and outcomes intended by the CPG developers and those in the obtained evidence [29]. Even if there was insufficient evidence of Japanese patients, the CPG developers could evaluate the body of evidence using the criteria for the certainty of evidence, including indirectness, and formulate recommendations based on such evidence. The progress in the CPG development methodology might have contributed to coping with no Japanese evidence in the CPG development process.

The CPG development methodologies, such as the GRADE approach that was developed by some of the original founders of the evidence-based medicine (EBM) movement, have improved over the last decade or more. Introducing the GRADE approach, the Japanese CPG development manual has emphasized on the comprehensiveness, transparency, and unbiasedness rather than the efficiency of systematic reviews in the CPG development process [29]. However, these methodologies may be highly technical and beyond many organized CPG efforts, including some who have formally endorsed the use of these methodologies [31]. No improvement was observed in the efficiency of evidence collection and appraisal in the results. Recently, rapid reviews, which accelerated the process of a traditional systematic review through streamlining or omitting various methods, have been conducted to produce evidence for stakeholders in a resource-efficient manner [32]. Cochrane, a global leader in the production of high-quality systematic reviews and methodological guidance, provided methodological recommendations for conducting rapid reviews [33]. Additionally, some tools for efficient systematic review have been developed and available [34, 35]. Although many challenges to the conduct of rapid reviews were addressed [36], the authors of CPG development manuals should consider introducing the methodology of rapid review and these tools to CPG developers in addition to rigorous methodologies.

With regard to expert involvement, some organizations offer support to the CPG development groups. In Japan, The MINDS Guideline Library assigns experts of CPG development to these groups [37], and several organizations, including the Japan Medical Library Association, offer support in searching for evidence in the CPG development process [38, 39]. Our results suggest that these forms of support might not fully meet the needs of the CPG development groups. Collaborating with McMaster University, Guidelines International Network (GIN), which is a global network of guideline producing organizations and guideline participants, has initiated a comprehensive, evidence-based, and up-to-date training program for CPG development group members [40]. In this program, GIN prepares the course for expert methodologist. It could increase the importance of and promote the standardization of experts. The organizations for support in the CPG development should introduce the CPG development groups about the importance of expert participation and establish an expert referral system that meets the CPG developers’ needs.

In addition to the problems noted in the previous study [16], “composing development group” has become a difficult process in CPG development. This survey revealed an increasing trend in the total number of CPG development group members and patients involved. Regarding the number of CPG development group members, Murphy et al. suggested that although having more group members increased the reliability of the group judgment, it caused coordination problems within the group [41]. As for patient involvement, Blackwood et al. recently revealed the paucity of knowledge on how to identify, incorporate and report patient preferences in CPGs through an international cross-sectional survey of CPG development organizations [42]. The lack of relevant knowledge, inability to separate personal experiences from systematic methods and analytical rules, and misunderstandings about EBM in patients makes it difficult to find an appropriate person who can consider the evidence objectively and make recommendations free of preconceived views or self-interests [2]. The increasing number of members and the progress of patient involvement in the CPG development groups might have increased the difficulty of group composition for CPG developers in the coordination and assignment of patient representatives. Piggott et al. suggested the contribution and participation of CPG development group members has become more demanding, although more guidance for CPG development is available. Therefore, they developed a guide for CPG development group members containing 33 items for consideration before, during and in follow-up to CPG group meetings and a description of each participant role [43]. The researchers on CPGs could help CPG development groups through clarifying the appropriate group composition based on the actual CPG development processes. Additionally, the support organization for the CPG development and dissemination should introduce the findings on the effective group composition including the above tool and description to CPG development groups.

This is the first study to reveal the long-term trends in CPG development activities through a cross-sectional questionnaire survey. However, it has several limitations. The response rate was not high, and there was a time lag between the CPG development and the current survey, as well as recall, selection, and unresponsive bias. The results might be biased towards the responses of the CPG development groups which have been involved in the CPG development and dissemination actively. Therefore, the results should be not interpreted as the trends for the general CPG development organizations.

Conclusions

Although there has been improvement in the patient involvement and coping with the paucity of Japanese evidence in the CPG development process in Japan, expert involvement and efficiency of evidence collection and appraisal have not. Our results revealed the need for methodological improvement in the efficient collection and appraisal of evidence and in the supporting system assigning experts to the CPG development groups.

Availability of data and materials

Summary data generated or analyzed during this study were included in this manuscript. If an external researcher contacts the corresponding author, the research team members will submit reviews of external provision of data to the Ethics Committee on behalf of external researchers. For data usage applications, the Ethics Committee of Toho University will examine whether the data requester can handle the data appropriately before sharing the data.

Abbreviations

AGREE:

Appraisal of Guidelines for Research and Evaluation

CPG:

Clinical practice guideline

EBM:

Evidence-based medicine

GIN:

Guidelines International Network

GRADE:

Grading of Recommendations Assessment, Development and Evaluation

STROBE:

Strengthening the Reporting of Observational Studies in Epidemiology

References

  1. Institute of Medicine Clinical Practice Guidelines. Directions for a new program. Washington DC: The National Academies Press; 1990.

    Google Scholar 

  2. Institute of Medicine Clinical Practice Guidelines we can Trust. Washington, DC: The National Academies Press; 2011.

  3. Ansari S, Rashidian A. Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012;7(11):e49864. https://doi.org/10.1371/journal.pone.0049864 PMID: 23189167; PMCID: PMC3506587.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Siering U, Eikermann M, Hausner E, Hoffmann-Eßer W, Neugebauer EA. Appraisal tools for clinical practice guidelines: a systematic review. PLoS One. 2013;8(12):e82915. https://doi.org/10.1371/journal.pone.0082915 PMID: 24349397; PMCID: PMC3857289.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Shekelle PG, Woolf SH, Eccles M, Grimshaw J. Developing clinical guidelines. West J Med. 1999;170(6):348–51 PMID: 18751155; PMCID: PMC1305691.

    CAS  PubMed  PubMed Central  Google Scholar 

  6. Hamashima C. Cancer screening guidelines and policy making: 15 years of experience in cancer screening guideline development in Japan. Jpn J Clin Oncol. 2018;48(3):278–86. https://doi.org/10.1093/jjco/hyx190 PMID: 29315389.

    Article  PubMed  Google Scholar 

  7. Nitta K, Masakane I, Tomo T, Tsuchida K, Ikeda K, Ogawa T, et al. Policy for developing clinical practice guidelines of Japanese Society for Dialysis Therapy. Ren Replace Ther. 2017;3(1):34. https://doi.org/10.1186/s41100-017-0116-9.

    Article  Google Scholar 

  8. Burgers JS, Grol R, Klazinga NS, Mäkelä M, Zaat J. AGREE collaboration. Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. Int J Qual Health Care. 2003;15(1):31–45. https://doi.org/10.1093/intqhc/15.1.31 PMID: 12630799.

    Article  PubMed  Google Scholar 

  9. Legido-Quigley H, Panteli D, Brusamento S, Knai C, Saliba V, Turk E, et al. Clinical guidelines in the European Union: mapping the regulatory basis, development, quality control, implementation and evaluation across member states. Health Policy. 2012;107(2–3):146–56. https://doi.org/10.1016/j.healthpol.2012.08.004 PMID: 22939646.

    Article  PubMed  Google Scholar 

  10. Furuhata T, Hirata K, Wakao F, Okita K, Imamura M, Maehara Y, et al. Questionnaire survey for the development and publication of cancer clinical practice guidelines in Japan. Int J Clin Oncol. 2014;19(5):771–8. https://doi.org/10.1007/s10147-014-0715-1 Erratum in: Int J Clin Oncol 2014 Oct;19(5):771–778. PMID: 24962287.

    Article  PubMed  Google Scholar 

  11. Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19(6):e58. https://doi.org/10.1136/qshc.2010.042077 PMID: 21127089.

    Article  PubMed  Google Scholar 

  12. Armstrong JJ, Goldfarb AM, Instrum RS, MacDermid JC. Improvement evident but still necessary in clinical practice guideline quality: a systematic review. J Clin Epidemiol. 2017;81:13–21. https://doi.org/10.1016/j.jclinepi.2016.08.005 Epub 2016 Aug 24. PMID: 27565978.

    Article  PubMed  Google Scholar 

  13. Zhou Q, Wang Z, Shi Q, Zhao S, Xun Y, Liu H, et al. Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A systematic review. J Clin Epidemiol. 2021:S0895-4356(21)00256-0. https://doi.org/10.1016/j.jclinepi.2021.08.013 Epub ahead of print. PMID: 34416326.

  14. Hasegawa T Study on the Evaluation of Clinical Practice Guidelines; 2003. (in Japanese).

  15. Hasegawa T Study on the Evaluation of Clinical Practice Guidelines; 2004. (in Japanese).

  16. Hasegawa T Study on the implementation and evaluation of clinical practice guidelines; 2006. (in Japanese).

    Google Scholar 

  17. Armstrong MJ, Rueda JD, Gronseth GS, Mullins CD. Framework for enhancing clinical practice guidelines through continuous patient engagement. Health Expect. 2017;20(1):3–10. https://doi.org/10.1111/hex.12467.

    Article  PubMed  Google Scholar 

  18. Tsertsvadze A, Chen YF, Moher D, Sutcliffe P, McCarthy N. How to conduct systematic reviews more expeditiously? Syst Rev. 2015;12(4):160. https://doi.org/10.1186/s13643-015-0147-7 PMID: 26563648; PMCID: PMC4643500.

    Article  Google Scholar 

  19. Hasegawa T Study on the influence of implementation of EBM based clinical practice guidelines on Healthcare; 2013. (in Japanese).

    Google Scholar 

  20. Database on clinical practice. Guidelines. Toho University Medical Media Center and Japan medical Abstracts Society, Tokyo. 2021. https://guideline.jamas.or.jp/. (in Japanese). Accessed 9 Aug 2021.

  21. Fukui T, Tango T. Procedures to develop clinical practice guidelines, version. 4.3, 2001. (in Japanese).

    Google Scholar 

  22. The AGREE Collaboration. Appraisal of guidelines for Research & Evaluation (AGREE) Instrument, translated Japanese version. 2003. (in Japanese).

  23. The AGREE Collaboration. Appraisal of guidelines for Research & Evaluation (AGREE) Instrument, 2001.

  24. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke J. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7. https://doi.org/10.1016/S0140-6736(07)61602-X PMID: 18064739.

    Article  Google Scholar 

  25. Fukui T, Yoshida M. Yamaguchi N MINDS handbook for clinical practice guideline development 2007. Tokyo: Igaku Shoin; 2007. (in Japanese)

    Google Scholar 

  26. Amano S. From the viewpoint of cancer patient. Gan To Kagaku Ryoho. 2019;46(8):1226–9 PMID: 31501361. (in Japanese).

    PubMed  Google Scholar 

  27. Japan Agency for Medical Research and Development Patient and public involvement guidebook. Tokyo: Japan Agency for Medical Research and Development; 2019. (in Japanese).

  28. Tanemura N, Sasaki T, Sato J, Urushihara H. Real world survey of patient engagement status in clinical research: the first input from Japan. Patient. 2020;13(5):623–32. https://doi.org/10.1007/s40271-020-00436-5 PMID: 32725324.

    Article  PubMed  Google Scholar 

  29. Kojimahara N, Nakayama T, Morizane T, Yamaguchi N, Yoshida M. Minds manual for guideline development 2017. Tokyo: Japan Council for Quality Health Care; 2017. (in Japanese)

    Google Scholar 

  30. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines. GRADE guidelines: 8. Rating the quality of evidence--indirectness. J Clin Epidemiol. 2011;64(12):1303–10. https://doi.org/10.1016/j.jclinepi.2011.04.014 PMID: 21802903.

    Article  PubMed  Google Scholar 

  31. Wyer PC. From MARS to MAGIC: the remarkable journey through time and space of the grading of recommendations assessment, development and evaluation initiative. J Eval Clin Pract. 2018;24(5):1191–202. https://doi.org/10.1111/jep.13019 PMID: 30109760.

    Article  PubMed  Google Scholar 

  32. Hamel C, Michaud A, Thuku M, Skidmore B, Stevens A, Nussbaumer-Streit B, et al. Defining rapid reviews: a systematic scoping review and thematic analysis of definitions and defining characteristics of rapid reviews. J Clin Epidemiol. 2021;129:74–85. https://doi.org/10.1016/j.jclinepi.2020.09.041.

    Article  PubMed  Google Scholar 

  33. Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, et al. Cochrane rapid reviews methods group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2021;130:13–22. https://doi.org/10.1016/j.jclinepi.2020.10.007.

    Article  PubMed  Google Scholar 

  34. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. https://doi.org/10.1186/s13643-016-0384-4 PMID: 27919275; PMCID: PMC5139140.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Marshall IJ, Kuiper J, Wallace BC. RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials. J Am Med Inform Assoc. 2016;23(1):193–201. https://doi.org/10.1093/jamia/ocv044 PMID: 26104742; PMCID: PMC4713900.

    Article  PubMed  Google Scholar 

  36. Tricco AC, Garritty CM, Boulos L, Lockwood C, Wilson M, McGowan J, et al. Rapid review methods more challenging during COVID-19: commentary with a focus on 8 knowledge synthesis steps. J Clin Epidemiol. 2020;126:177–83. https://doi.org/10.1016/j.jclinepi.2020.06.029.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Japan Council for Quality Health Care. MINDS Guideline Library. 2021. https://minds.jcqhc.or.jp/. (in Japanese). Accessed 9 Aug 2021.

  38. Japan Medical Library Association. Japan Medical Library Association website. Japan Medical Library Association. 2021. https://jmla1927.org/. (in Japanese). .

  39. International Medical Information Center. International Medical Information Center website. Tokyo: International Medical Information Center. 2021. https://www.imic.or.jp/. (in Japanese). Accessed 9 Aug 2021.

  40. Guidelines International Network and McMaster University. International Guideline Development Credentialing & Certification Program: INGUIDE. 2021. https://inguide.org/. Accessed 9 Aug 2021.

  41. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2(3):i–iv 1, 1–88. PMID: 9561895.

    Article  CAS  PubMed  Google Scholar 

  42. Blackwood J, Armstrong MJ, Schaefer C, Graham ID, Knaapen L, Straus SE, et al. How do guideline developers identify, incorporate and report patient preferences? An international cross-sectional survey. BMC Health Serv Res. 2020;20(1):458. https://doi.org/10.1186/s12913-020-05343-x PMID: 32448198; PMCID: PMC7247137.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Piggott T, Baldeh T, Akl EA, Junek M, Wiercioch W, Schneider R, et al. Supporting effective participation in health guideline development groups: the guideline participant tool. J Clin Epidemiol. 2021;130:42–8. https://doi.org/10.1016/j.jclinepi.2020.07.022 PMID: 32987163.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was supported in part by the Japan Society for the Promotion of Science KAKENHI Grant Numbers 20 K18863. The funder played no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Department of Social Medicine, Toho University School of Medicine, 5-21-16, Omori-Nishi, Ota-ku, Tokyo, 143-8540, Japan

    Yosuke Hatakeyama, Kanako Seto, Koki Hirata, Ryo Onishi, Kunichika Matsumoto & Tomonori Hasegawa

Authors
  1. Yosuke Hatakeyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kanako Seto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Koki Hirata
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ryo Onishi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kunichika Matsumoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tomonori Hasegawa
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YH and TH contributed towards the conception and design of the study. YH, KS and TH collected data. YH secured funding, analyzed data, interpreted data, drafted the manuscript. KS, KH, RO, KM and TH assisted in developing questionnaire, interpreting data, and revised the manuscript. All authors read and approved the submitted version.

Corresponding author

Correspondence to Tomonori Hasegawa.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of Toho University School of Medicine stated that this study was not applicable for ethical review under the Japanese regulations (No. A20064). Only those who accepted an informed consent statement participated the questionnaire survey. The study was carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declared that they had no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hatakeyama, Y., Seto, K., Hirata, K. et al. Trends in the development process of clinical practice guidelines: a questionnaire survey for the guideline development groups in Japan. BMC Health Serv Res 22, 94 (2022). https://doi.org/10.1186/s12913-022-07492-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-07492-7

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us