- Research article
- Open Access
- Open Peer Review
“One program that could improve health in this neighbourhood is ____?” using concept mapping to engage communities as part of a health and human services needs assessment
BMC Health Services Research volume 18, Article number: 150 (2018)
This paper presents the findings of a rapid needs assessment conducted at the request of the local health authority responsible for health care services, the Toronto Central Local Health Integration Network (Ontario, Canada), to inform health and social service planning.
We utilized concept mapping methodology to facilitate engagement with diverse stakeholders–more than 300 community members and service providers–with a focus on hard to reach populations. Key informant interviews with service providers were used to augment findings.
Participants identified 48 unique services or service approaches they believed would improve the health of residents in the area, including those addressing health care, mental health and addictions, youth, families, people experiencing homelessness, seniors, general social services, and services targeting specific populations. While service providers consistently identified a critical need for mental health and addiction services, community members placed greater importance on the social determinants of health including access to housing, job placement supports and training and service accessibility. Both groups agreed that services and programs for seniors and people experiencing homelessness would be highly important.
Our study provides a unique example of using concept mapping as a tool to aid a rapid service gap analysis and community engagement in a metropolitan area. The findings also reinforce the importance of working cross-sectorally, using a Health in All Policies approach when planning services for underserved populations.
Across the health services planning literature, the process of engaging community residents and specific targeted populations has been touted as a useful – if not essential – part of effective planning and evaluation [1,2,3,4]. Across the globe, public health departments, hospital systems, and social service planners are increasingly using focus groups, community forums, door-to-door surveys, and similar activities to gather the input of non-professionals and residents into long-term and strategic planning initiatives, to better involve them in decision-making [5,6,7]. These forms of gathering input recognize the importance of engaging in health planning with – rather than for – communities [5,6,7]. As the vantage point of the populations directly affected by health problems (and those for whom intervention and prevention programs are directed) is included and valued, community-engaged planning processes are particularly effective at identifying and addressing the social inequities that often result in health disparities and illness [8, 9]. Concept mapping is one such method to capture populations’ feedback.
Concept mapping (CM) is a participatory, mixed-methods approach that can be used to generate or conceptualize ideas, illustrate relationships between ideas, and rate ideas using a variety of criteria [10,11,12]. Data are collected and synthesized in three primary phases: brainstorming, sorting and rating, and mapping. Throughout these phases, an iterative process exists between the researcher(s) and participants as data moves back and forth between the two groups, with the final validation step resting with participants. Two of the strengths of this approach as a participatory research and planning tool include: (a) its ability to gather and synthesize input from multiple sources with different expertise and backgrounds, and (b) the limited nature researchers have over the data, analysis, and final results . Concept mapping has been used in a variety of capacities within the health services planning and evaluation field, from identifying characteristics or behaviors that signify health or well-being , elements that should be included in new programs approaches to service delivery [14,15,16], and to the development of a national public health strategic plan for addressing cognitive health [13,14,15,16,17]. Although the literature contains many examples of using CM to engage predefined groups of people (such as parents, teachers, students, and staff within a school or diabetic patients affiliated with a particular health system) [18,19,20], there are few examples of its use as a tool in regional or neighbourhood community-engaged needs assessments, and almost none in the peer-reviewed literature. Minh et al. (2015) used CM to conduct a needs assessment for youth in Toronto , and in the U.S., the team found one hospital system that incorporated CM into its community health assessment process, asking a community advisory council to identify the biggest health care problems and then engaging community residents in a subsequent rating and prioritization process .
This paper describes how concept mapping processes were integrated into a health and social services needs assessment to conduct a rapid yet participatory assessment of the needs within a geographically broad and demographically diverse area of Toronto, Ontario.
The use of concept mapping in health services planning is not new in Ontario, Canada. Since 2006, the oversight of health care in the province has been regionalized into 14 Local Health Integration Networks (LHINs), which are responsible for health services planning and delivery. Community engagement (CE) is a required part of this planning, and between 2008 and 2009, researchers and LHIN employees used concept mapping to explore how each of the LHINs conceptualized CE and developed a framework for future CE evaluation .
As a demonstration of this commitment to community engagement, in 2014, the Toronto Central LHIN (TC-LHIN) employed a local research center to conduct a needs assessment for a geographically-defined community near Toronto’s downtown core. According to the 2011 census, which collects data via the internet, phone, mail and one-on-one interviews , approximately 124,960 residents lived within the area, representing a 9.7% increase in population growth between 2006 and 2011 [25, 26]. The area included a high proportion of adults 20–44 years (47.4%), a low proportion of children 0–14 years (9.8%) and one of the highest proportions of seniors living alone compared to other parts of central Toronto. Almost 20% of residents spoke a primary language other than English, most commonly Mandarin, Cantonese, Chinese (nonspecific), Bengali, Tagolog, Spanish, and Tamil, and over 9% of the population immigrated to Canada in the previous five years . This area is characterized by wide economic inequities, with average family incomes ranging from $39,521 to $365,211. The scope of this assessment focused on individuals and families in the lower range of the spectrum, as 26% of individuals in private households lived below the poverty line . Data obtained by the TC-LHIN (Mid Toronto East Health Link, unpublished report, TC-LHIN, 2013) show that residents in the area faced a diverse array of health issues, including high rates of diabetes, asthma, chronic obstructive pulmonary disease, high blood pressure and low rates of mammograms, Pap smears, and other common health screenings. Leading causes of premature mortality, particularly in the low-income areas, included heart disease, lung cancer, HIV/AIDS, and intentional self-harm (Mid Toronto East Health Link, unpublished report, TC-LHIN, 2013). High utilization rates of emergency and mental and addiction health services were characteristic of this area (Mid Toronto East Health Link, unpublished report, TC-LHIN, 2013).
In response to the opening of a new medical clinic in the area, health planners from the funding agency wanted to know which social and mental health services area residents and service providers believed should also be available at the clinic. Upon the request of funder, the research team (AV, AM, NLF, PO) sought the opinions of key informants and area residents from several “priority populations.” These populations included youth, seniors, individuals of Indigenous decent, immigrants, self-identified LGBT, Mandarin and Bengali speakers, and individuals experiencing mental health or addictions issues. The research team collected opinions through a rapid assessment using concept mapping techniques with area residents and one-on-one interviews with key informants. Two main questions drove the research:
What are the needs and gaps in health and social services as perceived by residents and service providers?
Do these perceived needs and gaps differ by subgroup (e.g., service providers, residents, or identified priority populations)?
Concept mapping (CM) is a structured conceptualization process consisting of three phases: i) brainstorming ideas in response to a focal question, ii) rating the importance of the different brainstorming ideas, and iii) describing how these ideas are interconnected. Concept mapping is a semi-quantitative, participatory research method in which every participant’s voice counts in determining how a group views a particular topic or aspect of a topic [10, 27, 28]. Participants serve as experts because of their membership in specific groups of interest; in this case, this included residents from the neighbourhoods, members of the identified priority populations, health care providers, and representatives of social service organizations. The priority for this project, because of the very short turnaround time, was on the first two activities, brainstorming ideas and rating items and is the focus of this paper.
A community engagement plan was developed to ensure that feedback from community members, health and service providers and those using services in the region was collected. Six community animators, individuals knowledgeable of the neighourhoods in question, were hired to assist the research team with data collection. The animators used their familiarity with the area to identify locations (e.g., community organizations, clinics, or businesses) where members of the priority population congregate in order to directly recruit participants or foster connections with key representatives. The animators visited these neighbourhoods each day of the week, including weekends. Community animators:
Distributed flyers and information sheets to potential participants;
Conducted encounter interviews on the spot, gathering examples of programs and services during the brainstorming phase and later administering the rating sheets;
Recruited participants for group brainstorming sessions;
Recruited participants to complete the on-line surveys;
Visited community organizations to engage staff and participants and hold on-site brainstorming sessions.
Data collection and analysis occurred in two phases over approximately 5 weeks in 2015. In phase one, participants took part in one-on one brainstorming sessions with community animators, facilitated group sessions, or electronically using email or through Concept Systems Global Max© software. Participants were told about the plans to provide new services and were asked to respond to the following question: One program or service that would improve the health of the residents living in [this area of the city] is___________________________. Participants were encouraged to provide as many responses to this question as they wished. The research team then systematically condensed over 250 responses to 48 by eliminating duplicate responses and combining similar ideas. In phase two, participants were asked to rate each item on a 6-point Likert scale based on the degree to which the item would improve individuals’ health and how frequently the programs or services would be used (see Table 1). Participants who attended the facilitated group sessions were reimbursed for travel in the form of transit tokens, and light snacks and beverages were provided. The sessions and online surveys were conducted in English, and some group sessions were held in Mandarin, one of the most non-English languages spoken in the area, using a translator.
Regardless of specific activity or the setting, all participants who took part in rating were asked to complete a short demographic survey. The survey captured information on participants’ age, gender, education, whether they were born in Canada or were immigrants, where they currently live, and how they were connected to the community (e.g. resident, service provider, employed in the area, etc.). A map of the catchment area was available to clarify the geographic boundaries. Participants did not include any identifying information on the questionnaire.
Key informant interviews
As a complementary process to the concept mapping activities, individual interviews were conducted in person or by phone with key representatives of health and social service organizations. The individuals interviewed held leadership roles (e.g. director, CEO, lead physician, manager) at these organizations and help determine the allocation of resources as well as the capacity to organize/deliver services. The purpose of conducting these interviews was to supplement the concept mapping information with data that illustrated the perceptions and priorities of decision-makers within the organizations that currently served the area. Interviews were approximately 20 min in length and consisted of open-ended questions and probes for further clarification, when necessary.
All participants provided verbal consent to participate. This was in accordance with the Research Ethics Board of St. Michael’s Hospital (protocol #14–052), based on a desire to protect the anonymity of the concept mapping participants and because the risks involved with participation were minimal.
Concept mapping data were entered into the Concept Systems Global Max© software and subject to hierarchal cluster analyses and multidimensional scaling. “Go-zone” figures  were used to visually display how service providers and community members perceived the importance of services by both its likelihood to improve health and to be frequently used. “Pattern Match” figures  allowed us to display the correlation between the ratings of two participant groups. A correlation coefficient (r) provided a statistical measure of the overall relationship between the ratings of services or participant groups according to the two rating questions.
Key informant interviews
Key informant interviews were audio recorded and transcribed verbatim, and all identifying information was removed. Using content analysis approach , and hand coding, investigators identified main themes related to needs and gaps in the service system and priority populations.
Over 150 participants took part in phase one and nearly 200 participants took part in phase two of concept mapping. As the brainstorming phase of concept mapping generates collective rather than individual data, individual-level collection of demographic data was limited to those who took part in the rating exercises, and of these, approximately 80% completed a demographic survey. Of the participants who completed rating forms for at least one of the three scales and provided demographic data (n = 144), almost 62% reported living or working in the area, and 61% said they received health or social services within the community. Sixteen percent of participants indicated they were health or social services providers in the area. Roughly 20% of participants were youth under 18 years of age, over half identified as female, and almost 40% were immigrants to Canada. While 20% of individuals reported earning a Bachelor’s degree or higher, almost another 30% of participants had not completed high school. Please see Table 2 for an overview of participant demographics.
During the brainstorming phase, over 250 responses were recorded, which the research team reduced to 48 unique items by eliminating duplicates and combining similar ideas into a single item. Our final list included specific services or programs, (e.g., walk in dental clinic), services for specific populations (e.g., in-home care for seniors), and desired characteristics of programs (e.g., culturally appropriate health care services). The items were organized into nine clusters representing related concepts: health care, mental health and addictions, youth, family, social services, community and recreation, homeless, seniors, and other populations. The left-side of Table 3 shows a complete list of the final 48 services, organized by cluster.
Table 3 illustrates how both service providers and community members rated the 48 items in terms of their importance to health and the frequency they would likely be used (ranks of top rated items are shown in parentheses). A key finding is that community residents and service providers held different perspectives on what was most critically needed. Service providers ranked four of the five mental health services as the highest in importance to improve health. Conversely, community members’ top ratings only included one mental health item – mental health services for those experiencing homelessness – as a service that would improve health. Further, community members clearly identified non-clinical social services as those that would be used frequently and of greater benefit to health. These services included assistance finding affordable housing, job training, food banks, and services for domestic violence victims and seniors, as well as efforts to increase the accessibility of health care services to specific populations.
Using go-zones, which compare ratings using a bivariate graph divided into quadrants determined by dividing above or below each variable’s mean score , the team examined the relationship between the likelihood a service would improve health and the likelihood that the service would be used, looking separately at service providers’ and community members’ responses (Figs. 1 and 2). In both figures, the green-shaded quadrant (I) represents the items which are both most likely to improve health and most likely to be used by members of the community. This area represents the “Go-Zone,” where effort may be more likely to pay off (e.g., not only will helping community members find affordable housing (item 13) positively contribute to their health, but it would be used frequently). Quadrant II contains those items which are less likely to improve health, although they would be likely to be used frequently. Quadrant III items were ranked lowest in terms of frequency of use and effectiveness on health, and Quadrant IV illustrates those items that may contribute to health improvement, but would not be used very often. Again, service providers placed particular importance on mental health services, whereas community members focused on social determinants of health, including assistance finding affordable housing, job placement and training, food banks, services for women experiencing domestic violence and services for seniors (See Table 4 for list of top ranked services or service approaches by participant type based on the average rating scores across both questions). Service providers’ perspectives correlated more than the community members.
Finally, the team examined differences between service providers’ and community members’ categorical priorities using pattern matching. While both groups ranked individuals experiencing homelessness and senior services as important, service providers perceived mental health and addiction as the most important cluster of services to improve health, which greatly differed from community members who ranked services for people facing homelessness as the most important, followed by social services. Both service providers and community members agreed that health care was one of the least important clusters.
Community members tended to rank items as close in importance to each other (illustrated by the tight clustering of services on the right side of Fig. 3). Conversely, service providers perceived some services were more important than others. Findings were similar when the team examined the rating of service clusters that would be frequently used by the residents of the community (not shown).
As different populations have unique needs, the team also investigated whether perceptions about the frequency with which certain services would be used differed by participant demographics. For example, while both Canadian-born and immigrant participants rated health and mental health services as having equal levels of importance, Canadian-born participants believed that services for people experiencing homelessness would be used with greater frequency than non-Canadian born participants, whereas the latter group prioritized services for seniors. Likewise, people with less than a high school education ranked the social cluster the highest or most likely to be used with greater frequency, those with at least a high school education believed that mental health and addiction and senior services would be frequently accessed.
Key informant interviews
Eighteen key informants were interviewed, representing the leadership of 7 types of organizations: community health centres; general hospitals; primary care providers; community health, mental health and social service providers; and community care access centres. Key themes that emerged included the need for improved access to services for individuals experiencing homelessness, those living with mental health problems, and those facing multiple health problems and challenging social conditions. Services for immigrants were also cited as requiring attention, and language barriers were identified as central. Finally, respondents identified a need for more coordination and integration of health and social services. These interviews confirmed many CM findings such as the needs of priority populations that were captured in the brainstorming phase of concept mapping. Several strategies to improve access and utilization of services were also discussed, including making services easier to apply for and increasing availability outside of traditional office hours.
When key informants were asked about service gaps, many believed the area already had a wealth of programs and services; however, the extent and nature of these services needed to be clarified for residents and other service providers. As one participant noted:
“I just think the issue is not that the services aren’t there, it’s, for whatever reason, the coordination just hasn’t been there between all the organizations in [the neighborhood]. I think a lot of it is, we have the money for the priority health care, we don’t have the extra resources for self-promotion and community engagement.”
Concerning the issue of health care, many informants noted that access to stable, continuous primary care was the most important area of focus to improve health. As one participant said,
“I think the first requirement is access to stable, continuous primary care. I think we need to look at it in flexible ways, in evenings and weekends, because I think that is the way to avoid, prevent the use of the emergency department.”
This was consistent with the view that more outreach into the community via methods such as mobile staffing and satellite offices would also increase access by community members. One key informant noted these methods would be beneficial for hard to reach patients and supportive to family physicians.
While community mental health programs are well provided, many believe that they are not well connected with psychiatry and there is a serious need for community psychiatric support. Many key informants identified a gap in the provision of urgent psychiatric care to support primary care practitioners and to meet the needs of the population in general, as well as for specialized groups such as children, seniors and individuals with a mental health diagnosis. There was also a strong need for psychiatric assessment and greater support for medication adherence.
This paper presents the findings of a rapid needs assessment which integrated several concept mapping methods into a community engagement process. By doing so, the team was able to include the input from a wide range of populations, including many who are often left out of health services planning, such as individuals experiencing homeless, immigrants, youth, seniors, and those with mental health and addiction issues [30,31,32]. This process also allowed our team to identify discrepancies between the opinions of professional service providers and those of community members about health and social service priorities in the area.
Considering that neither group viewed any service or category to be of low importance (indicating a need for a wide range of services), this distinction in perspective is critical from the standpoint of resource allocation and services planning. Whereas service providers consistently identified mental health and addiction programs as most critical to health and as those that would be frequently used, community members spoke strongly about gaps in services that address the social determinants of health. It could be argued that service providers’ identification of these programs reflects greater awareness among providers about mental health problems and existing strategies and programs; and that providers working in the field of mental health and addictions or whose clients struggle with psychological issues and substance abuse are likely to focus on the numerous gaps in these programs.
Conversely, by rating social rather than clinical services so highly, the individuals who are most likely to use these services may be acknowledging a very practical reality, that before specific services focused on substance abuse, mental health, or physical well-being can be effectively addressed, people need stable housing, food, and adequate safety as well as services that can be accessed when and where they people need them. The key informant interviews reinforce this last point as well. Although focused on service provision, many informants echoed the sentiment that it would be most beneficial to improve the coordination and integration of pre-existing services rather than create new services.
It is clear that none of the 48 services were considered unimportant to the community, although some were ranked higher than others. Moreover, the findings reinforce several key areas of importance. First, if asked, community residents think about health broadly and understand that social determinants are as important as clinical services. While this may seem simplistic, even when community health and needs assessments use community-engaged methods, many traditional approaches only ask residents to prioritize health problems rather than identify solutions [33, 34]. Yet when asked, residents clearly recognize that social and structural inequities, including unemployment, housing and food instability, and violence are at the root of community health . This clearly suggests service providers, policy makers, and health officials need to work cross-sectorally, and promote a ‘Health in All Policies’ approach to find ways to meet core needs, such as housing and safety to impact the overall health status and health system costs for the population.
Second, better coordination and communication between clinical and social services are essential . In terms of next steps, the compatibility of the services placed in one facility should be considered, along with the physical set-up of the space and with the potential opportunities for better coordination and collaboration between programs and providers in a shared space [37, 38]. In case of planning multiple services, either by proposing shared space for multiple services or making services available on a rotating basis, providing client case management or services coordination could be especially beneficial to clients with multiple service needs. The project’s funder intends to use the findings of the assessment plan to determine which social or mental health service should be included in the clinic space.
Finally, this article advocates for the use of concept mapping as an innovative participatory strategy for community health assessment and improvement planning. In the U.S., community health needs assessments and improvement plans are required of health care organizations and public health agencies to maintain tax-exempt status and accreditation [1, 39, 40]. Widely-used assessment frameworks such as The Mobilizing for Action through Planning and Partnership process  place community engagement squarely at the core of effective assessment, yet these assessments, when done using common approaches to focus groups and community surveys, run the risk of only involving the partners who are traditionally involved in service delivery, without truly engaging a broad spectrum of community residents [42, 43]. The work presented here, as well as that of Burke and colleagues  illustrates how concept mapping methods can be used to engage a large and diverse cross-section of communities in the process of assessing and prioritizing issues related to health. In particular, this method was a rapid and efficient means of incorporating the perspectives and preferences of many of the priority populations for the Local Health Integration Network such as those who are not housed or those who do not speak any of the official languages. Time and expense are often cited as a reason to not engage broadly with priority populations, and true community based participatory research methods are often labor, time, and resource intensive to do well [42, 44]. Concept mapping activities could be a means to overcome these barriers.
Limitations and strengths
Limitations of the project should be briefly noted. First, the study was launched with a condensed time frame in which to collect these data, which limited the approaches to recruitment (e.g., scheduled group events with sufficient time for RSVP and reminder calls); possibilities to involve more participants from specific priority groups (e.g., from non-English speaking populations); and to explore service gaps across these groups. The short timeframe and logistics of engaging participants in community settings also limited our methodology, and the team did not complete the mapping phase usually done during concept mapping. This was unfortunate, as it did not allow the research team to hear how community members themselves conceptualized the findings and to learn if they would have interpreted the differences between providers and residents in the same way. Second, the project focused on perceived gaps in services. The method the team chose prevented us from documenting whether gaps that surfaced were a result of a lack of availability or due to barriers caused by a lack of coordination between different providers/services/programs.
Our study also had several strengths. Despite the short time frame, researchers managed to engage widely throughout the community, reaching out to several hundred residents and service providers within the area, as a result of a targeted recruitment process. Usually when communities are consulted, residents are asked to come to a meeting to provide input, severely limiting the population providing feedback [42, 44]. In our case, community animators went to the community, to places where residents lived, worked, shopped, and received services. This enabled us to involve multiple segments of individuals in the area including those who may be unlikely to participate in after-hours focus groups or to complete and return a survey. In addition, planners from the funding agency helped to reach out to their service providers in the area and engage them to participate in the study. This way, our sample represents a population that may not be generalizable to the entire region, but consists of those who use and/or provide services and was ideal for this gap analysis.
These findings demonstrate the importance of planners going into communities, where people live, work, and play, and asking about their needs. Our results suggest that consideration of multiple perspectives, especially of hard to reach population groups, is important in order to identify and implement services to improve health in the area. Projections about the future demographic composition of the populations in an area should also be carefully considered when planning services, with special attention to the needs of those groups with the largest predicated population growth.
Local Health Integration Network
Toronto Central Local Health Integration Network
Barnett K. Best practices for Comunity health needs assessment and implementation Stragtegy development: a review of scientific methods, Curreng practices, and future potential. Atlanta, GA: centers for disease Congtrol and Prevention; 2012.
Minkler M, Blackwell AG, Thompson M, Tamir H. Community-based participatory research: implications for public health funding. Am J Public Health. 2003;93(8):1210–3.
O'Mara-Eves A, Brunton G, McDaid G, Oliver S, Kavanagh J, Jamal F, Matosevic T, Harden A, Thomas J. Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis. Public Health Research. 2013;1:4.
Wells KB, Tang J, Lizaola E, Jones F, Brown A, Stayton A, Williams M, Chandra A, Eisenman D, Fogleman S, et al. Applying community engagement to disaster planning: developing the vision and Design for the Los Angeles County Community Disaster Resilience Initiative. Am J Public Health. 2013;103(7):1172–80.
Ahari SS, Habibzadeh S, Yousefi M, Amani F, Abdi R. Community based needs assessment in an urban area; a participatory action research project. BMC Public Health. 2012;12(1):161.
Lightfoot AF, De Marco MM, Dendas RC, Jackson MR, Meehan EF. Engaging underserved populations in affordable care act-required needs assessments. J Health Care Poor Underserved. 2014;25(1):11–8.
Zoellner J, Motley M, Wilkinson ME, Jackman B, Barlow ML, Hill JL. Engaging the Dan River region to reduce obesity: application of the comprehensive participatory planning and evaluation process. Fam Community Health. 2012;35(1):44–56.
Minkler M, Wallerstein N. Improving health through community organization and community building. In: Glanz K, Rimer BK, Lewis FM, editors. Health Behaviors and Health Education: Theory, Research, and Practice. San Francisco: Jossey-Bos; 2002.
Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(S1):S40–6.
Kane M, Trochim WM. Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage; 2007.
Trochim WMK, Milstein B, Wood BJ, Jackson S, Pressler V. Setting objectives for community and systems change: an application of concept mapping for planning a statewide health improvement initiative. Health Promot Pract. 2004;5(1):8–19.
Trochim W, Kane M. Concept mapping: an introduction to structured conceptualization in health care. Int J Qual Health Care. 2005;17(3):187–91.
Sheppard AJ, Salmon C, Balasubramaniam P, Parsons J, Singh G, Jabbar A, Zaidi Q, Scott A, Nisenbaum R, Dunn J. Are residents of downtown Toronto influenced by their urban neighbourhoods? Using concept mapping to examine neighbourhood characteristics and their perceived impact on self-rated mental well-being. Int J Health Geogr. 2012;11(1):31.
Shorkey C, Windsor LC, Spence R. Assessing culturally competent chemical dependence treatment services for Mexican Americans. J Behav Health Serv Res. 2009;36(1):61.
Snider CE, Kirst M, Abubakar S, Ahmad F, Nathens AB. Community-based participatory research: development of an emergency department–based youth violence intervention using concept mapping. Acad Emerg Med. 2010;17(8):877–85.
Vaughn LM, Jacquez F, McLinden D. The use of concept mapping to identify community-driven intervention strategies for physical and mental health. Health Promot Pract. 2013;14(5):675–85.
MK SD, Brownson R, Kane M, Cross A: Using concept mapping to develop a logic model for the prevention research centers program. 2006.
Streeter CL, Franklin C, Kim JS, Tripodi SJ. Concept mapping: an approach for evaluating a public alternative school program. Children & Schools. 2011;33(4):197–214.
Marchand C, d'Ivernois J, Assal J, Slama G, Hivon R. An analysis, using concept mapping, of diabetic patients' knowledge, before and after patient education. Med Teach. 2002;24(1):90–9.
Johnson SL, Burke JG, Gielen AC. Prioritizing the school environment in school violence prevention efforts. J Sch Health. 2011;81(6):331–40.
Minh A, Patel S, Bruce-Barrett C, O'Campo P. Letting youths choose for themselves: concept mapping as a participatory approach for program and service planning. Fam Community Health. 2015;38(1):33–43.
Community Health Needs Assessment and Community Health Strategic Plan. In. Venango County, PA: UPMC Northwest; 2013.
Jabbar AM, Abelson J. Development of a framework for effective community engagement in Ontario, Canada. Health Policy. 2011;101(1):59–69.
Statistics Canada. 2011 Census Program, Key Facts for the National Household Survey. http://www12.statcan.gc.ca/nhs-enm/2011/ref/info-eng.cfm]. Accessed 16 Feb 2018.
Statistics Canada, Archived Content, Census Tract (CT) Profiles, 2006 Census. http://www12.statcan.gc.ca/census-recensement/2006/dp-pd/prof/92-597/index.cfm?Lang=E. Accessed 16 Feb 2018.
Statistics Canada. 2012. GeoSearch. 2011 Census. Statistics Canada Catalogue no. 92-142-XWE. Ottawa, Ontario. Data updated October 24, 2012. http://geodepot.statcan.gc.ca/GeoSearch2011-GeoRecherche2011/GeoSearch2011-GeoRecherche2011.jsp?lang=E&otherLang=F. Accessed 17 Feb 2018.
Trochim WM. An introduction to concept mapping for planning and evaluation. Evaluation and program planning. 1989;12(1):1–16.
O’campo P, Burke J, Peak GL, McDonnell KA, Gielen AC. Uncovering neighbourhood influences on intimate partner violence using concept mapping. J Epidemiol Community Health. 2005;59(7):603–8.
Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15.
Crowley P, Green J, Freake D, Drinkwater C. Primary care trusts involving the community: is community development the way forward? Journal of management in medicine. 2002;16(4):311–22.
Attree P, French B, Milton B, Povall S, Whitehead M, Popay J. The experience of community engagement for individuals: a rapid review of evidence. Health & social care in the community. 2011;19(3):250–60.
De Vos P, De Ceukelaire W, Malaise G, Pérez D, Lefèvre P, Van der Stuyft P. Health through people's empowerment: a rights-based approach to participation. health and human rights. 2009:23–35.
Santilli A, Carroll-Scott A, Ickovics JR. Applying community organizing principles to assess health needs in new haven, Connecticut. Am J Public Health. 2016;106(5):841–7.
Baig K, Shaw-Ridley M, Munoz OJ. Applying geo-spatial analysis in community needs assessment: implications for planning and prioritizing based on data. Evaluation and program planning. 2016;58:42–8.
Hebert-Beirne J, Felner JK, Castañeda Y, Cohen S. Enhancing themes and strengths assessment: leveraging academic-led qualitative inquiry in community health assessment to uncover roots of community health inequities. Journal of Public Health Management and Practice. 2017;23(4):370–9.
Kodner DL. Whole-system approaches to health and social care partnerships for the frail elderly: an exploration of north American models and lessons. Health & Social Care in the Community. 2006;14(5):384–90.
Blue-Howells J, McGuire J, Nakashima J. Co-location of health Care Services for Homeless Veterans: a case study of innovation in program implementation. Soc Work Health Care. 2008;47(3):219–31.
Sloper P. Facilitators and barriers for co-ordinated multi-agency services. Child Care Health Dev. 2004;30(6):571–80.
Guide to National Public Health Department Initial Accreditation. In. Alexandria, VA: Public Health Accreditation Board; 2015.
The Internal Revenye Service's Final Rule. Charitable hospitals & community health needs assessments. Alexandria VA: Association of State and Territorial Health Officials; 2014.
Mobilizing for Action through Planning and Partnerships (MAPP) [https://www.naccho.org/programs/public-health-infrastructure/performance-improvement/community-health-assessment/mapp]. Accessed 17 Feb 2018.
Katz AS, Cheff RM, O’Campo P. Bringing stakeholders together for urban health equity: hallmarks of a compromised process. Int J Equity Health. 2015;14(1):138.
Pennel CL, McLeroy KR, Burdine JN, Matarrita-Cascante D, Wang J. A mixed-methods approach to understanding community participation in community health needs assessments. J Public Health Manag Pract. 2017;23(2):112–21.
Wetta RE, Dong F, LaClair B, Pezzino G, Orr SA. Factors affecting the progress of community health assessment and improvement activities in Kansas. J Public Health Manag Pract. 2015;21(4):E1–9.
We are grateful to those who assisted with the research including: Shirley Bryan and Cynthia Damba, TC-LHIN; Sheila Braidek, Executive Director, Regent Park Community Health Centre; Philip Ellison, Primary Care Physician Advisor, TC-LHIN; Robin Griller, Director, Mid-East Toronto Health Link.
We thank Arman Hamidian, Adam Whisler, Caroline Patterson, Nickole Worrell, Chantel Guthrie, Jaime Aguiler, and Melinda Silfavan for their contributions to assisting with recruitment of participants and collection of data. Amy Katz helped to prepare our final report.
Finally, we would like to thank the individuals, service providers and community members of the Mid-East Toronto Health Link area who generously dedicated their time to share their invaluable insights with us through interviews and concept mapping sessions.
The views expressed in this publication are the views of the authors and do not necessarily reflect the views of the TC-LHIN.
AM assisted with study design, data collection, analysis, and manuscript preparation. AV and NLF participated in data collection, analysis, and manuscript preparation. PO served as the principle investigator for the project, leading the study design and analysis, overseeing data collection, participating in manuscript preparation and revisions. AR and MB helped to conceptualize this research, contributed substantially to the study design and were involved with manuscript development and provided critical revisions. All authors reviewed and approved the final version of this manuscript and are accountable for all aspects of this work.
Funding for this project was provided by the Toronto Central Local Health Integration Network. The funding body did not have any role in the design of the study nor in data collection, analysis, interpretation, or manuscript development.
Availability of data and materials
Data requests should be submitted to Dr. Patricia O’Campo with the Centre for Urban Health Solutions at St. Michael’s Hospital: o’firstname.lastname@example.org.
At the time of the research, AV was an ACHIEVE Postdoctoral Fellow with the Centre for Urban Health Solutions (previously the Centre for Research on Inner City Health), Li Ka Shing Knowledge Institute at St. Michael’s Hospital in Toronto, Ontario, Canada. She is presently an Assistant Professor at the University of Illinois at Chicago School of Public Health in Chicago, Illinois, USA, and remains an affiliated scientist with Centre for Urban Health Solutions. AM was also an ACHIEVE Postdoctoral Fellow with the Centre for Urban Health Solutions in Toronto, Li Ka Shing Knowledge Institute at St. Michael’s Hospital in Toronto, Ontario, Canada, and is presently an official with the European Commission. NLF contributed to the work as a research coordinator at the Centre for Urban Health Solutions at St. Michael’s Hospital, Li Ka Shing Knowledge Institute in Toronto, Ontario, Canada. AR was with the Toronto Central Local Health Integration Network when this research was conducted, and is now with WoodGreen Community Services in Toronto, Ontario. MB was with the Toronto Central Local Health Integration Network when this research was conducted, and is presently with Health Quality Ontario. PO is presently a research scientist and Chair in Intersectoral Solutions to Urban Health Problems at the Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute at St. Michael’s Hospital in Toronto, Ontario, Canada and is a Professor at the Dalla Lana School of Public Health, University of Toronto.
Ethics approval and consent to participate
All participants verbally acknowledged informed consent prior to participation – this was done to ensure concept mapping participant anonymity, and because the risks related to participation were very minor. This method of verbal consent – as well as the research project as a whole – was approved by the St. Michael’s Hospital Research Ethics Board, Protocol #14–052.
Consent for publication
None of the authors have financial or non-financial competing interests to report.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Velonis, A.J., Molnar, A., Lee-Foon, N. et al. “One program that could improve health in this neighbourhood is ____?” using concept mapping to engage communities as part of a health and human services needs assessment. BMC Health Serv Res 18, 150 (2018) doi:10.1186/s12913-018-2936-x
- Community engagement
- Community health services assessment
- Concept mapping
- Health services planning