Experiences of Norwegian child and school health nurses with the “Starting Right™” child health assessment innovation: a qualitative interview study
BMC Health Services Research volume 22, Article number: 728 (2022)
Although child health services are well established in Norway, the use of information technology for the systematic collection of evidence-based child- and proxy-reported health measures may be beneficial in the early identification of child development problems. The Norwegian “Starting Right™” health service innovation consists of parent- and child-reported online structured health assessments tools, including practical routines for child and school health assessments. The aim of this study was to explore the experiences of child and school health nurses with the Starting Right innovation.
We used a qualitative design and conducted three focus group interviews with 18 child and school health nurses from three child health centres one year after the implementation of the innovation.
The experiences of professionals with the Starting Right innovation were captured by three themes: (1) the digital innovation could be used to obtain a good overview of a child’s health and development; (2) interpreting the questionnaires was a challenge; and (3) implementing the new digital innovation was time-consuming.
Overall, the child and school health nurses experienced that the Starting Right innovation was useful for providing a comprehensive overview of child development and health. The challenges related to interpreting the parents’ scores and follow-up of children, as well as providing the questionnaires in relevant foreign languages, should be addressed to allow all children and families to be reached.
Although child health services in Nordic countries and Scotland are well developed for safeguarding the health and development of children, assessments and surveillance are hindered by the lack of evidence-based screening and evaluations of interventions . In western countries screening of children’s health is recommended, but delivery and content vary considerably between countries . According to Alexander , service providers in the United States (US) rarely rely on relevant clinical end-points to assess the intended and/or expected health changes in children which is similarly reported for the Nordic countries .
The proportion of children with poor health is growing slightly , and the trajectories of poor health commence and are identifiable early in the lives of children . Shonkoff et al.  have suggested the need for initiatives to strengthen the resilience of children and efforts to protect children from unhealthy development. These initiatives should rely on evidence-based measures and interventions that are acceptable, feasible, and affordable, and they should strengthen informed professional and parental engagement .
In a study of the competence needs of child and school health nurses (CSHNs) in Finland, where child health care is comparable with that in Norway, Putkuri et al.  reported that intuitive and interpersonal competencies are well developed in child health care. However, it is necessary to advance and develop theoretical and evidence-based competencies, including the use and interpretation of health assessment scales. Furthermore, advanced electronic patient records and digital tools are required to support evidence-based screening tools and intervention strategies. For example, another study conducted in Finland using online tools determined the utility and appropriateness of a mental health screening tool (strength and difficulties questionnaire, SDQ), as well as how to overcome barriers to support parents and develop competence among CSHNs . In a Swedish project nurses preferred using SDQ to assess mental health of children in child health clinics, but emphasized the importance of reducing individual and organizational level barriers . In addition, systematically collecting data on the development and health of children can facilitate the distribution of services to geographical areas with the highest need for follow-up .
Nurses throughout the world have reported a need to establish positive therapeutic relationships with families amid growing concerns about child health challenges [11, 12], and it is necessary to validate their experience-based and situated concerns about children . In particular, structured health assessments can improve the identification of children’s problems , provide decision support , create opportunities for evaluating interventions , and enhance communication . Client-reported questionnaires concerning their health can enhance routine management by promoting client–clinician communication and client involvement . Moreover, digital health assessments may be preferable and more acceptable for clients than paper-based questionnaires because of their faster completion time, lower cost, and increased response rate with resulting higher data quality . However, the challenges associated with client-generated health data acquired using electronic tools include financial investment, privacy protection, and the exclusion of populations not familiar with electronic devices and platforms . In addition, the ability to respond to patient generated health data could be challenging, including integration in clinical practices and processes . In general, health care professionals are reported to have high digital literacy, but one-fifth report anxiety using information technology, which could endanger patient safety and the quality of service, and thus targeted training is required for staff with low digital literacy .
Validated structured health assessments using information technology need to be implemented in child and school health services. The Norwegian “Starting Right™” project uses digital proxy- and child-reported questionnaires to support CHSNs in assessments of the general and socio-emotional development of children’s health and development. This project has been piloted in routine child and school health care  using an online solution delivered by CheckWare Ltd. The Starting Right child and school health service innovation consists of parent- and child-reported online structured health assessments tools, including practical routines for use in assessments of child and school health services among children aged from six months to 16 years . Previously validated questionnaires are used in the innovation, such as the SDQ , health-related quality of life (KIDSCREEN-27) [23, 24], general development (ages and stages questionnaire) , socio-emotional development (ages and stages questionnaire: social–emotional) , and anxiety (Spence child anxiety scale, short) questionnaires . Parental acceptability and adoption by CSHNs were satisfactory in the pilot phase . Before implementation, the preparation stage included monthly meetings with two CSHNs, having an official mandate for professional quality improvement in a large municipality in Norway. The instruments and starting age for screening were selected in collaboration with the relevant services, and information about the innovation was attached to an appointment letter sent to parents. Educational sessions concerning the questionnaires (5 h) and online tool (3 h) were provided to all CSHNs before implementation at the centres involved . In the pilot phase, a medical secretary supported the CSHNs in distributing health assessments to parents prior to scheduled appointments, which increased the rate of adoption by CSHNs .
It is recommended to evaluate clinical experiences to identify challenges and required improvements, and to accommodate and provide further support with implementation . In their design and evaluation implementation framework, Fixsen et al.  described seven core implementation components: (1) staff selection; (2) pre-service and in-service training; (3) ongoing coaching and consultation; (4) staff evaluation; (5) decision support data systems; (6) facilitative administrative support; and (7) systems interventions . In the present study, we focused on the core component of staff evaluation with the specific aim of exploring the experiences of CSHNs with the Starting Right innovation.
We employed a qualitative approach to explore the experiences of CSHNs with the implementation of the Starting Right innovation, which were assessed by conducting focus groups and then analysed the data by thematic analysis .
Participants and setting
A purposive sampling of CSHNs was performed from three different child health centres in two municipalities in Southern Norway covering birth cohorts of approximately 450 children. The participants recruited by the manager at each centre comprised CSHNs with experience of working with the Starting Right child and school health service innovation since the start between October and December 2019. Eighteen CSHNs agreed to participate. CSHNs are the main professional group in the child and school health services. The CSHNs are required to have a minimum of one year of education (60 European Credit Transfer and Accumulation System (ECTS)) in addition to a bachelor’s degree in nursing. Norwegian CSHNs are specialists  and has a central role in the health promoting and preventive work in the municipalities . The nurses are qualified to promote mental and physical health, promote good social and environmental conditions, prevent illness and injuries, and prevent and detect violence, abuse and neglect .
Norwegian child and school health services are organised in an interdisciplinary manner within the municipality primary health care system [1, 33]. The child health service in Norway is provided free of charge and it offers a minimum of 14 consultations for children aged 0 − 5 years located in the municipality of the child and parents, and the school health services provide individual appointments in at least grades 1 and 8 . These services aim to promote the physical and mental health of children as well as their social conditions, and help and advice are offered by CSHNs, physicians, and physiotherapists .
Semi-structured focus groups were conducted to allow participants to discuss, reflect on, and exchange viewpoints, and this approach was found to be appropriate for meeting the aims of the present study . Data were collected in suitable quiet rooms in the child health centres over a period of two months in November and December 2020. The focus groups were conducted for the CSHNs in three groups comprising five, six, and seven participants from each of the public health centres. The focus groups were moderated by two of the authors (LF and NR), where one acted as moderator and the other as co-moderator . Both researchers are registered nurses with extensive experience in qualitative research studies; they were not directly involved in the implementation of the innovation, and they had no clinical experience or education in public health nursing.
The focus group questions were designed to obtain an understanding of the experiences of the CSHNs with the Starting Right innovation. The focus group guide covered aspects of the experiences of the CSHNs with using the digital tool (access to the software, electronic documentation, use of time, and extracting reports). In addition, the guide covered aspects concerning how the use of systematically collected data may contribute to the follow-up of children at the public health centres. The focus groups were audio recorded and lasted 47–58 min.
Thematic analysis was conducted with a combination of inductive and deductive data coding and analysis . The interviews were manually transcribed verbatim by a professional transcriber and the analysis was conducted by the two researchers who moderated the focus groups. The transcribed text was imported into the data management software program NVivo 12 Pro for Windows . The first phase of the analysis involved familiarisation with the data. All of the transcribed text was read and re-read to understand the meaning of the text as a whole. According to Braun and Clarke (page 87) , reading should be conducted in an “active way, searching for patterns and meanings”. During the second phase, initial codes were inductively generated by dividing the text into units based on the semantic level of meaning. In the third phase, the meaning units that shared the same features were clustered into three latent themes across the data set guided by the following overall themes from the interview guide: user friendliness, serviceability, and follow-up. In phases four and five, the themes were reviewed against the meaning units, defined, and named .
Eighteen female CSHNs aged 36–63 years participated in the study. They had 13–36 years of experience as registered nurses, with 2–26 years of experience as trained CSHNs. Thematic analysis was conducted according to three themes: (1) the digital innovation could be used as a method to obtain a good overview of a child’s health and development; (2) interpreting the questionnaires was a challenge; and (3) implementation of the new digital innovation was time-consuming. We now discuss these three themes in turn and illustrate them with quotes from the participants.
The digital innovation could be used as a method to obtain a good overview of a child’s health and development
Despite the delay of the innovation due to the coronavirus outbreak, the overall response from the CSHNs concerning its serviceability was positive. They emphasised the importance of their involvement during the implementation process and using the innovation because they were aware of any bottlenecks or other issues, and the new routines influenced their daily work.
It is about which tools we use… it is like telling a carpenter that you should use that hammer instead of the other hammer… if you take it to extremes. Of course, you could discuss the tools [questionnaires] that we use today because even if we had used them for years, other tools could be more suitable. But I think it [the decision about which tools to use] should come from us as users. (Focus group 1)
They experienced that the systematic collection of data provided a more integrated and comprehensive impression of a child’s development and health.
I think that we know about these issues but you understand them in a much more systematic manner when you have the possibility to score the child, you see? It is a little bit more than an overview… less speculation compared with what the parents have answered in detail [in the questionnaires] concerning emotions, for example. (Focus group 3)
Although the majority of the CSHNs perceived the innovation as an important and useful tool for following up children, those with longer work experience found it less useful compared with those with shorter work experience.
As I told you, I really don’t know if I am doing a better four-year consultation or school start consultation since we started this [innovation]. (Focus group 1)
One important issue discussed in the focus group was that both the CSHNs and parents were more prepared when scoring their child’s strengths and weaknesses.
I usually tell the parents who have filled out the questionnaires, that it is very helpful for me to read their answers in advance because I might not know their child. Because it gives you an impression of who this child is and you might then recognise some of those things, and then you can have a good conversation about it. (Focus group 2)
The innovation was experienced as a tool that could be used for communicating information about deviations in child health and development to other services, such as kindergarten or family centres. However, the CSHNs wanted guidance about how to follow up on these deviations.
There is no point in discovering these things if we don’t do anything different anyway. So, I think there should be a package of interventions… yes, something that tells us who we should contact or what we should do. If not, it will be a bit pointless I think. (Focus group 2)
The CSHNs also discussed the possibility of involving other professionals such as teachers from the kindergarten to obtain a more nuanced picture of a child’s development and health.
However, the inability to merge data from the intervention with the patient’s journal software was described as an obstacle.
Interpreting the questionnaires was a challenge
Providing ongoing and timely information to parents about how to fill in the questionnaires was experienced as crucial. According to the CSHNs, some of the parents might not have visited the public health centre for a long time, and they suddenly received information about the project and a request to respond to the questionnaires. The CSHNs suggested that contacting the parents in advance to prepare them for the upcoming questionnaire could have been beneficial.
Yes, we should have contacted the parents and explained it to them because then we could have clarified issues that they were unclear about… they would have been able to ask questions instead of just receiving an information sheet to sign. (Focus group 2)
They agreed that most parents actually wanted to contribute but the effort of filling in the questionnaires could have outweighed the benefits of participating.
Do they understand the benefit of it? Because if they don’t, they probably won’t respond to the questions. They need to feel that it is beneficial to them [and their child], otherwise they will lack the motivation to participate in the project. (Focus group 2)
The nurses were sometimes unsure whether the parents had actually understood the questions, which could be especially challenging for parents who were not native speakers of Norwegian.
I think about the language… if they don’t understand the nuances and the words used in the questionnaires, then it could be difficult for them to understand. And it is important that they can read it in their own language. So, in fact, it is not strange that they don’t answer because they don’t understand it [the question], and this makes it difficult for them to answer. (Focus group 2)
Another topic discussed in the focus groups was the relevance of the answers provided by the parents. One of the participants called the data collected a “fresh product” that could soon be outdated.
One advantage is that we receive this information quickly. Right? If they tick that the child is often agitated with reduced concentration, becomes angry, and things like that, then immediately you can start to talk about it and say I can see that you have marked this out… do you want to talk about it… is it something that influences your everyday life? And if you run out of time, you can suggest another consultation to talk more about it. That provides us with an opportunity. (Focus group 3)
The usefulness of the selected questionnaires was an issue discussed by the participants. Some considered that the questions were somewhat negatively biased by focusing on problems rather than a child’s strengths, but others considered that this was necessary to capture a comprehensive understanding of the child’s condition.
We have more of a health promotion focus… they [the questions] are slightly more problem focused, like “do you often fall out with somebody”? But you must be a little problem focused as well to identify the difficulties [and other participants agreed]. If they [the questions] are just positively biased, we do not get the answers we need. (Focus group 3)
Another issue that interested the participants was which parents responded and whether they helped the parents who needed extra support.
Because we have talked about the fact that those who we really would like to answer the questionnaires before consultations, they don’t… those are the ones we would like to reach. But the resourceful ones, they usually fill in the forms and are happy with that. So, we wonder, have we got any further? (Focus group 1)
Mothers generally responded to the questionnaires. The nurses suggested that this could be explained by various reasons, such as whether it was clear that both parents could answer the questionnaires, or if contact information was available for both mothers and fathers in the child’s journal. When both parents responded and evaluated their child’s development differently, this discrepancy could sometimes challenge the CSHN’s perception of the child.
I have seen both [similar and different descriptions]. There are nuances in how mothers and fathers describe their child, and that is always interesting. (Focus group 3)
Consultations with ethnic minority parents were described as even more challenging due to language and cultural issues.
I have met quite a few minority families who don’t understand how they should respond to it [the questionnaire]… and then they do not understand, and haven’t filled it out… and how should I handle this, and I have to admit that I don’t do anything… I think it is a lot of fuss. (Focus group 2)
Another challenging issue during follow-up was how some parents perceived and scored their child, and the different perception of the CSHN. This issue was a new experience for the participants that arose after implementing the innovation.
I also have a mum who basically has quite a few challenges with her child who was followed up by the rehabilitation services… it was a completely normal score. That is how she perceived her child. So, it’s interesting. I thought maybe it would have been a higher score on the SDQ, but it was not. Maybe it’s about how you perceive your own child. (Focus group 1)
In addition to differences in how parents perceived their child, the participants in the focus groups discussed parents who downplayed their child’s health issues to CSHNs.
Because I also think that there can be a bit of under-reporting, and I also think that those (parents) who do not respond, these are often parents that may struggle with their child in one way or another, and who find it difficult, or may not know their children well enough. So, it will also be exciting to see this in the long run and how it will be. (Focus group 2)
Implementation of the new digital innovation was time-consuming
One of the main issues discussed by the CSHNs during the interviews was that using the new digital tool was perceived as more time-consuming, thereby resulting in extra work for both CSHNs and parents. The agenda at the child and school health centre was rather packed, with little or no spare capacity. Thus, finding time for the extra work during 6–10 consultations in one day could be challenging, especially if they had to combine their consultations with the doctors’ appointments (Focus group 3). However, the experiences of the CSHNs varied. Some described how prioritising the innovation replaced other topics that were previously included in the consultations. Others stated that the only difference was that documentation was conducted using the new digital tool instead of the electronic patient journal. Some initial challenges regarding the recording of the results were discussed in all of the interviews.
And then we need some time to become confident ourselves to understand the reports and how to discuss the findings with parents. I really think it works mostly. But as we say, I had a negative attitude to logging results in the system because it is more time-consuming and you need more keystrokes than before. But when you have recorded the results and look at them [the completed questionnaire], I think it is good. (Focus group 2)
After the CSHNs became acquainted with interpreting the results, they were still concerned about the amount of extra work required of the parents filling out (Focus group 1) and understanding multiple questionnaires.
They take a lot of time just to record the results, just as we do. Then they must read through all the material, and then there are things they don’t understand… after having looked at the huge amount of text, they just put it off… and then they don’t bother to do anything about it… many parents have told me that that they looked at it, but they did not do anything about it. (Focus group 2)
The aim of the present study was to explore the experiences of CSHNs with the implementation of the Starting Right child and school health service innovation. Overall, our findings indicated that the nurses were positive about the innovation. However, their experiences with the implementation varied and some of them were contradictory. Despite this motivation to implement the health service innovation, previous studies have shown that the implementation of structured self-reported health assessments can lead to diverse experiences, such as challenges including assessments as standard practice , given that the implementation process involves complex interactions between various factors . Our findings are in agreement with previous studies that highlight, for example, scepticism regarding the validity of patient self-reporting, uncertain clinical benefits, concerns about workflow, and the lack of time [40, 41].
The digital innovation could be used as a method to obtain a good overview of a child’s health and development
The CSHNs emphasised the importance of their involvement in the implementation and use of the innovation. Some CSHNs were involved in planning the innovation and in selecting the instruments used  but the participants in the present study considered that the currently used questionnaires should be changed according to their needs. Their practice was not based on traditions of using structured and validated health assessment tools, standardised forms, or systematic assessments in accordance with the World Health Organisation criteria for these tools , but they had to follow quite detailed national guidelines . Thus, there could be differences in how to interpret their professional obligations in relation to the implemented assessments, and reciprocal and continuous adjustments of the innovation may be important beyond the pilot phase, as we reported previously . Waldron et al.  also emphasised the need for continuing education when implementing routine outcome measures. Moreover, competence needs concerning the assessment rating scales and aetiology of symptoms, as well as appropriate interventions, were highlighted by Putkuri et al.  for a comparable child and school health service innovation in Finland.
In the present study, the CSHNs found that using the innovation led parents to reflect more actively on their child’s development and health before the consultation. This finding appears to be consistent with previous investigations of the experiences of patients using self-reports of health, and thus these questionnaires may prompt patients to reflect on their own health . Reflecting by using structured self-reported health assessments may increase the likelihood of raising personal issues with clinicians . Furthermore, this may allow CSHNs to be more prepared for the consultation.
Interpreting the questionnaires was a challenge
One of the main concerns raised by the CSHNs was the ability of parents to fill in the questionnaires. They found that some of the parents had problems understanding the meanings of the questions and they were concerned whether this might result in the parents postponing filling in the questionnaires or not responding. In addition, the issue of a language barrier, especially for ethnic minority parents, was considered a further problem that affected the ability of parents to respond. Several questionnaires have been translated into different languages and they were accessible as paper versions for translation support in the centres but online digital questionnaires were only accessible in Norwegian during the implementation phase of the Starting Right innovation. Clearly, the lack of access to questionnaires in different languages could have prevented ethnic minority parents from completing the questionnaires, as shown in previous studies [43, 44]. In Norway, approximately 15% of the population are immigrants , and in 2020, approximately 26.000 of the population received Norwegian language training of which 1 out of 4 where from Syria .
Another challenge to the implementation process may have been related to the “digital divide”, which is considered one of the major disadvantages of online structured self-reporting of health. A systematic review by Meirte et al.  found that people with limited access to computers or those who are generally computer illiterate are likely to be disadvantaged. If the parents encountered challenges because they lacked access to computers or mobile phones or had problems understanding the questionnaire, then they clearly would have had difficulty in filling in the questionnaires. Our previously reported parental response rate of 80–85%  also indicates that a group of parents did not respond to the questionnaires. These findings correspond with a Swedish study who revealed that nurses experienced that not all parents filled in the questionnaires . The occasional parents who did not respond could be a challenge for the CSHNs in their daily clinical work regardless of their reasons for not responding.
Some of the CSHNs experienced differences between their own perceptions of a child and the scores provided by some of the parents. They described cases of parents who both over- and under-estimated their child’s development and health challenges compared with their own perceptions. It is well known that people tend to respond in a manner that might be considered socially acceptable, especially when dealing with sensitive issues . Social desirability can result in under-reporting due to the tendency to present oneself in a manner that is socially acceptable, or even to avoid criticism . For some parents, social desirability might be an issue when scoring their child because they may be unwilling to reveal certain information. Some parents might also believe that questionnaires do not capture their concerns . However, some of the nurses experienced the opposite where parents reported concerns about their children that were not perceived by the CSHNs. These findings agree with those obtained in other studies where low agreement was observed between the assessments of health professionals and parents regarding their children [51, 52]. Previous studies have also highlighted the need for clear cut-off values and interpretations of questionnaires such as the SDQ in different situations and contexts , and it may be necessary to use population-level data to improve these interpretations. On the other hand, the scores obtained from questionnaires might provide health professionals with information regarding previously unidentified issues , thereby allowing them to provide appropriate advice or interventions to meet the needs of children . Several nurses argued that although most of the information regarding children was known to them, the specific conditions of children were clarified by the questionnaires, as also shown previously . An integrative review by Lines et al.  highlighted that working with vulnerable children involves putting “pieces of a jigsaw puzzle” together through communication and validation. In the present study, the discrepancies observed by CSHNs between different information sources suggest that health assessments alone may not be sufficient to meet the needs of CSHNs. Lines et al.  argue that nurses have concerns about making mistakes and harming children or families when trying to provide support, or take action based on their “gut feeling” that something is wrong. We will argue that different information sources, including questionnaire-based health assessment scores, are needed to support nurses in taking appropriate action. Thus, although questionnaires can be considered tools for formally assessing the health situations of children, they do not entirely solve the dilemma of balancing surveillance with support. They cannot necessarily guide a quick and obvious response, which may have been required by nurses in the present study, as well as in general . The systematic mapping of a child’s health and development may result in an increased commitment to the further utilisation of knowledge, and the nurses suggested that there is a requirement for a framework to determine how and when follow-ups should be performed for children with special needs. These findings echo those obtained in a systematic review by Boyce et al.  who reported that one of the barriers that hinders the implementation of questionnaire-based health assessments may be uncertainty about how the scores should be interpreted and how to transfer these interpretations into clinical care. Greenhalgh et al.  note that clinicians often have limited knowledge about how to implement structured questionnaire-based data in clinical practice. Similarly, Putkuri et al.  found that CSHNs need greater competence in using assessment rating scales, in understanding the aetiology of mental health symptoms in children, and of knowledge of the chain of care as well as preventive interventions.
The CSHNs were very concerned about whether the intervention might enhance the identification and support of families and children with health care issues. A realist synthesis by Greenhalgh et al.  showed that the use of questionnaire-based health assessments by clinicians is strongly influenced by their professional roles and relationships with patients. Clinicians indicated that standardised patient reported outcome measures (PROMs) could hinder communication and relationships with patients, whereas more individualised PROMs could strengthen the dialogue .
Implementation of the new digital innovation was time-consuming
The time required by the innovation was considered an important issue by CSHNs and they were concerned about how it influenced their current working situation. In particular, they were concerned about the time taken to use the innovation during the implementation phase, such as when distributing questionnaires and access reports in the system. Implementing questionnaire-based health assessments is time-consuming  and although online tools can facilitate more time-efficient assessments, Meirte et al.  reported that time constraints remain barriers that may be related to digital literacy. The nurses described the value of access to support, especially concerning technical issues during the implementation phase, which may reflect challenges concerning digital literacy among CSHNs and that special support and training could be needed, as reported previously . The issues of digital literacy and level of digital support could also explain the difference in the adoption rate identified in a pilot study of the implementation of the Starting Right innovation , in which the adoption rate was 96% in a group supported by a medical secretary in the pilot phase, but only 55% among CSHNs with no support. This discrepancy may indicate that CSHNs need extended support to overcome barriers related to time requirements when implementing the innovation.
Strengths and limitations
The present study was conducted during the COVID-19 pandemic. As a consequence, some of the child and school health services temporary suspended their implementation or use of the Starting Right project, which inevitably affected the experiences of the nurses with the innovation. Nevertheless, we successfully recruited 18 CSHNs with a wide range of ages and years working as CSHNs, and thus a broad range of experience in public health nursing; these factors can be considered strengths of this study. Another strength was that the focus groups were moderated by two researchers who were registered nurses, and part of the research group, but they were not involved in the implementation of the innovation.
Although the Starting Right project had only been piloted for about one year, abundant data were obtained from the initial phase of the implementation. However, if the interviews had been conducted later, we could have obtained information about how the questionnaires were used after the initial challenges were addressed. In addition, our participants only comprised female nurses. Including male participants in Norwegian studies is a challenge because the proportion of male CSHNs in Norway in 2018 was only 0.3% .
Overall, the CSHNs considered that the Starting Right innovation for child development and health assessments was useful for providing a comprehensive overview of the development and health of children. However, several challenges were identified, especially regarding how to interpret the scores provided by parents and how to use these scores to follow up their children. There is also a need to provide online questionnaires in different languages to reach all children and families.
Availability of data and materials
All relevant data are presented in this paper. Transcripts from the study are available from the corresponding author on reasonable request.
child and school health nurse
European Credit Transfer and Accumulation System
Wilson P, Wood R, Lykke K, Hauskov Graungaard A, Ertmann RK, Andersen MK, et al. International variation in programmes for assessment of children’s neurodevelopment in the community: Understanding disparate approaches to evaluation of motor, social, emotional, behavioural and cognitive function. Scandinavian J Public Health. 2018;46(8):805–16. https://doi.org/10.1177/1403494818772211.
Wood R, Blair M. A comparison of C hild H ealth P rogrammes recommended for preschool children in selected high-income countries. Child Care Health Dev. 2014;40(5):640–53. https://doi.org/10.1111/cch.12104.
Alexander KE, Brijnath B, Biezen R, Hampton K, Mazza D. Preventive healthcare for young children: A systematic review of interventions in primary care. Prev Med 2017;99:236–250. https://doi.org/10.1016/j.ypmed.2017.02.024.
Meherali S, Punjani N, Louie-Poon S, Abdul Rahim K, Das JK, Salam RA, et al. Mental health of children and adolescents amidst CoViD-19 and past pandemics: a rapid systematic review. Int J Environ Res Public Health. 2021;18(7):3432. https://doi.org/10.3390/ijerph18073432.
Nilsen W, Kjeldsen A, Karevold EB, Skipstein A, Sand Helland M, Gustavson K, et al. Cohort Profile: The Tracking Opportunities and Problems Study (TOPP)–study of Norwegian children and their parents followed from infancy to early adulthood. Int J Epidemiol. 2017;46(5):1399–1399g. https://doi.org/10.1093/ije/dyx057.
Shonkoff JP, Boyce WT, Levitt P, Martinez FD, McEwen B. Leveraging the biology of adversity and resilience to transform pediatric practice. Pediatrics. 2021;147(2). https://doi.org/10.1542/peds.2019-3845.
Putkuri T, Salminen L, Axelin A, Lahti M. Good interaction skills are not enough–competency in mental health issues in child health clinics and school health services. Scand J Caring Sci. 2021. https://doi.org/10.1111/scs.12956.
Ristkari T, Mishina K, Lehtola MM, Sourander A, Kurki M. Public health nurses’ experiences of assessing disruptive behaviour in children and supporting the use of an Internet-based parent training programme. Scand J Caring Sci. 2020;34(2):420–7. https://doi.org/10.1111/scs.12744.
Fält E, Salari R, Fabian H, Sarkadi A. Facilitating implementation of an evidence-based method to assess the mental health of 3–5-year-old children at Child Health Clinics: A mixed-methods process evaluation. Plos one. 2020;15(6):e0234383. https://doi.org/10.1371/journal.pone.0234383.
Barry SJE, Marryat L, Thompson L, Ellaway A, White J, McClung M, et al. Mapping area variability in social and behavioural difficulties among Glasgow pre-schoolers: linkage of a survey of pre-school staff with routine monitoring data. Child Care Health Dev. 2015;41(6):853–64. https://doi.org/10.1111/cch.12237.
Westergren T, Fegran L, Antonsen AJ, Mikkelsen HT, Hennig C, Köpp US. Prevention of overweight and obesity in a Norwegian public health care context: a mixed-methods study. BMC Public Health. 2021;21(1):1–11. https://doi.org/10.1186/s12889-021-11096-x.
Lines LE, Hutton AE, Grant J. Integrative review: nurses’ roles and experiences in keeping children safe. J Adv Nurs. 2017;73(2):302–22. https://doi.org/10.1111/jan.13101.
Eklund K, Renshaw TL, Dowdy E, Jimerson SR, Hart SR, Jones CN, et al. Early identification of behavioral and emotional problems in youth: Universal screening versus teacher-referral identification. Calif School Psychol. 2009;14(1):89–95. https://doi.org/10.1007/BF03340954.
Sim F, O’Dowd J, Thompson L, Law J, Macmillan S, Affleck M, et al. Language and social/emotional problems identified at a universal developmental assessment at 30 months. BMC pediatrics. 2013;13(1):1–7. https://doi.org/10.1186/1471-2431-13-206.
Bagner DM, Rodríguez GM, Blake CA, Linares D, Carter AS. Assessment of behavioral and emotional problems in infancy: A systematic review. Clin Child Fam Psychol Rev. 2012;15(2):113–28. https://doi.org/10.1007/s10567-012-0110-2.
Van Minde M, Hulst S, Raat H, Steegers E, de Kroon M. Postnatal screening and care for non-medical risk factors by preventive child healthcare in deprived and non-deprived neighbourhoods. BMC Health Serv Res. 2018;18(1):1–9. https://doi.org/10.1186/s12913-018-3243-2.
Aiyegbusi OL, Isa F, Kyte D, Pankhurst T, Kerecuk L, Ferguson J, et al. Patient and clinician opinions of patient reported outcome measures (PROMs) in the management of patients with rare diseases: a qualitative study. Health Qual Life Outcomes. 2020;18(1):1–12. https://doi.org/10.1186/s12955-020-01438-5.
Meirte J, Hellemans N, Anthonissen M, Denteneer L, Maertens K, Moortgat P, et al. Benefits and disadvantages of electronic patient-reported outcome measures: systematic review. JMIR Perioper Med. 2020;3(1):e15588. https://doi.org/10.2196/15588.
Lavallee DC, Lee JR, Austin E, Bloch R, Lawrence SO, McCall D et al. mHealth and patient generated health data: stakeholder perspectives on opportunities and barriers for transforming healthcare. Mhealth 2020;6. https://doi.org/10.21037/mhealth.2019.09.17.
Kuek A, Hakkennes S. Healthcare staff digital literacy levels and their attitudes towards information systems. Health informatics J. 2020;26(1):592–612. https://doi.org/10.1177/1460458219839613.
Westergren T, Mølland E, Haraldstad K, Håland ÅT, Køpp UM, Fegran L, et al. Implementation of the norwegian ‘Starting right’ child health service innovation: implementation adjustments, adoption, and acceptability. BMC Public Health. 2021;(21):1-9. https://doi.org/10.1186/s12913-021-06096-x.
Sveen TH, Berg-Nielsen TS, Lydersen S, Wichstrøm L. Detecting psychiatric disorders in preschoolers: Screening with the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2013;52(7):728–36. https://doi.org/10.1016/j.jaac.2013.04.010.
Andersen JR, Natvig GK, Haraldstad K, Skrede T, Aadland E, Resaland GK. Psychometric properties of the Norwegian version of the Kidscreen-27 questionnaire. Health Qual Life Outcomes. 2016;14(1):1–6. https://doi.org/10.1186/s12955-016-0460-4.
Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, et al. The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value Health. 2008;11(4):645–58. https://doi.org/10.1111/j.1524-4733.2007.00291.x.
Martinussen M, Valla L. Måleegenskaper ved den norske versjonen av Ages and Stages Questionnaires (ASQ). 2013.
Stensen K, Stenseng F, Lydersen S, de Wolff MS, Wallander J, Drugli MB. Screening for mental health problems in a Norwegian preschool population. A validation of the ages and stages questionnaire: Social-emotional (ASQ: SE). Child Adolesc Mental Health. 2018;23(4):368–75. https://doi.org/10.1111/camh.12257.
Reardon T, Spence SH, Hesse J, Shakir A, Creswell C. Identifying children with anxiety disorders using brief versions of the Spence Children’s Anxiety Scale for children, parents, and teachers. Psychol Assess. 2018;30(10):1342. https://doi.org/10.1037/pas0000570.
Waldron SM, Loades ME, Rogers L. Routine outcome monitoring in CAMHS: how can we enable implementation in practice? Child Adolesc Mental Health. 2018;23(4):328–33. https://doi.org/10.1111/camh.12260.
Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. 2009;19(5):531–40. https://doi.org/10.1177/1049731509335549.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101. https://doi.org/10.1191/1478088706qp063oa.
Mulcahy H, Leahy-Warren P, Laholt H, Philpott LF, Bergvoll LM, Clancy A. Public health nursing education in Ireland and Norway: A comparative analysis. Public Health Nursing. 2022;39(1):279–85. https://doi.org/10.1111/phn.13039.
Kunnskapsdepartementet: Forskrift om nasjonal retningslinje for helsesykepleierutdanning. In. Edited by Kunnskapsdepartementet; 2021.
Helsedirektoratet.National guideline for health promotion and preventive work in the child and youth health centres and school health service, 0–20 years In: National Guideline. 2021. https://www.helsedirektoratet.no/retningslinjer/helsestasjons-og-skolehelsetjenesten/dokumenter-helsestasjons-og-skolehelsetjenesten/National%20guideline%20for%20health%20promotion%20and%20preventive%20work%20in%20the%20child%20.pdf/_/attachment/inline/854312bb-434e-4aab-b7eb-125d558eb434:a0aaa3fec5902792de20d18abfddeee13bd377c8/National%20guideline%20for%20health%20promotion%20and%20preventive%20work%20in%20the%20child%20.pdf. Accessed September 9. 2021
Helse Norge.Infant healthcare programme, age 0–5 years In: Help services in the municipalities. 2020. https://www.helsenorge.no/en/help-services-in-the-municipalities/infant-healthcare-programme-age-0-5-years/. Accessed September 24. 2021
Curtis E, Redmond R. Focus groups in nursing research. Nurse Res 2007;14(2). https://doi.org/10.7748/nr2007.01.14.2.25.c6019.
Malterud K. Fokusgrupper som forskningsmetode for medisin og helsefag. Oslo: Universitets forlaget; 2012.
QSR International.NVivo 12 Pro In. 2020. https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home. Accessed May 10. 2021
Foster A, Croot L, Brazier J, Harris J, O’Cathain A. The facilitators and barriers to implementing patient reported outcome measures in organisations delivering health related services: a systematic review of reviews. J Patient Rep Outcomes. 2018;2(1):1–16. https://doi.org/10.1186/s41687-018-0072-3.
Nilsen P. Implementering. Teori och tillãmpning inom hãlso & sjukvård. Lund, Sweden: Studentlitteratur AB; 2010.
Harle CA, Listhaus A, Covarrubias CM, Schmidt SO, Mackey S, Carek PJ et al. Overcoming barriers to implementing patient-reported outcomes in an electronic health record: a case report. J AM Med Inform Assoc 2016;23(1):74–79. https://doi.org/10.1093/jamia/ocv085.
Boyce MB, Browne JP, Greenhalgh J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf 2014;23(6):508–518.
Greenhalgh J, Gooding K, Gibbons E, Dalkin S, Wright J, Valderas J, et al. How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient Rep Outcomes. 2018;2(1):1–28. https://doi.org/10.1186/s41687-018-0061-6.
Amini M, Oemrawsingh A, Verweij LM, Lingsma HF, Hazelzet JA, Eijkenaar F, et al. Facilitators and barriers for implementing patient-reported outcome measures in clinical care: An academic center’s initial experience. Health Policy. 2021. https://doi.org/10.1016/j.healthpol.2021.07.001.
Schamber EM, Takemoto SK, Chenok KE, Bozic KJ. Barriers to completion of patient reported outcome measures. J Arthroplasty. 2013;28(9):1449–53. https://doi.org/10.1016/j.arth.2013.06.025.
Statistics Norway.Innvandrere og norskfødte med innvandrerforeldre In: Befolkning. 2020. https://www.ssb.no/befolkning/innvandrere/statistikk/innvandrere-og-norskfodte-med-innvandrerforeldre. Accessed May 3. 2022
Statistics Norway.Norsopplæring for norske innvandrere In: Utdanning. 2020. https://www.ssb.no/utdanning/voksenopplaering/statistikk/norskopplaering-for-voksne-innvandrere. Accessed May 3. 2022
Fält E, Sarkadi A, Fabian H. Exploring nurses’, preschool teachers’ and parents’ perspectives on information sharing using SDQ in a Swedish setting–a qualitative study using grounded theory. PloS one 2017;12(1):e0168388. https://doi.org/10.1371/journal.pone.0168388.
van de Mortel TF. Faking it: social desirability response bias in self-report research. Aust J Adv Nurs 2008;25(4):40–48. https://doi.org/10.3316/informit.210155003844269.
King MF, Bruner GC. Social desirability bias: A neglected aspect of validity testing. Psychol Mark 2000;17(2):79–103. https://doi.org/10.1002/(SICI)1520-6793(200002)17:2<79::AID-MAR2>3.0.CO;2-0.
Greenhalgh J. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res. 2009;18(1):115–23. https://doi.org/10.1007/s11136-008-9430-6.
Reijneveld SA, de Meer G, Wiefferink CH, Crone MR. Parents’ concerns about children are highly prevalent but often not confirmed by child doctors and nurses. BMC Public Health. 2008;8(1):1–10. https://doi.org/10.1186/1471-2458-8-124.
Crone MR, Zeijl E, Reijneveld SA. When do parents and child health professionals agree on child’s psychosocial problems? Cross-sectional study on parent–child health professional dyads. BMC Psychiatry. 2016;16(1):1–12. https://doi.org/10.1186/s12888-016-0867-9.
Goodman A, Goodman R. Strengths and difficulties questionnaire as a dimensional measure of child mental health. J Am Acad Child Adolesc Psychiatry. 2009;48(4):400–3. https://doi.org/10.1097/CHI.0b013e3181985068.
Frost MH, Bonomi AE, Cappelleri JC, Schünemann HJ, Moynihan TJ, Aaronson NK et al. Applying quality-of-life data formally and systematically into clinical practice. In: Mayo Clinic Proceedings: 2007: Elsevier; 2007: 1214–1228.
Wolpert M, Curtis-Tyler K, Edbrooke-Childs J. A Qualitative Exploration of Patient and Clinician Views on Patient Reported Outcome Measures in Child Mental Health and Diabetes Services. Adm Policy Ment Health. 2014;43(3):309–15. https://doi.org/10.1007/s10488-014-0586-9.
Haverman L, Limperg P, Young N, Grootenhuis M, Klaassen R. Paediatric health-related quality of life: what is it and why should we measure it? Arch Dis Child. 2017;102(5):393–400. https://doi.org/10.1136/archdischild-2015-310068.
Greenhalgh J, Abhyankar P, McCluskey S, Takeuchi E, Velikova G. How do doctors refer to patient-reported outcome measures (PROMS) in oncology consultations? Qual Life Res. 2013;22(5):939–50. https://doi.org/10.1007/s11136-012-0218-3.
Bergsagel I. Her er alle Norges mannlige helsesøstre. In. Sykepleien; 2018.
The General Data: Protection Regulation [Personopplysningsloven]. 2018.
We are grateful to the CSHNs who participated in this study.
The project was funded by the Regional Research Fund in Agder, Norway (Grant no. 285009). The funding contributed to covering the costs of implementing the Starting Right innovation, conducting the focus groups, analysis, and reporting the current study.
Ethics approval and consent to participate
The study was in Accordance with relevant guidelines and regulations. Ethics approval was obtained from the Faculty of Health and Sport Sciences Ethics Board, the university research director (April 5, 2019) at the University of Agder and Norwegian Centre for Research Data (No. 630027).
All participants gave written informed consent to participate in the study, and were informed about their rights according to data protection regulations .
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Robstad, N., Westergren, T., Mølland, E. et al. Experiences of Norwegian child and school health nurses with the “Starting Right™” child health assessment innovation: a qualitative interview study. BMC Health Serv Res 22, 728 (2022). https://doi.org/10.1186/s12913-022-08088-x
- Child and school health nurses
- Child health
- Digital innovation
- Health service innovation
- Public health nurses
- School health