Skip to main content
  • Research article
  • Open access
  • Published:

Statistical complexity of reasons for encounter in high users of out of hours primary care: analysis of a national service

Abstract

Background

Managing demand for urgent and unscheduled care is a major problem for health services globally. A particular issue is that some patients appear to make heavy use of services, including primary care out of hours. We hypothesised that greater variation (statistical complexity) in reasons for attending primary care out of hours services may be a useful marker of patients at high risk of ongoing heavy service use.

Methods

We analysed an anonymised dataset of contacts with the primary care out of hours care for Scotland in 2011. This contained 120,395 contacts from 13,981 high-using patients who made 5 or more contacts during a calendar year. We allocated the stated reason for each encounter into one of 14 categories. For each patient we calculated measures of statistical complexity of reasons for encounter including the count of different categories, Herfindahl index and statistical entropy of either the categories themselves, or the category transitions. We examined the association of these measures of statistical complexity with patient and healthcare use characteristics.

Results

The high users comprised 2.4% of adults using the service and accounted for 15% of all contacts. Statistical complexity (as entropy of categories) increased with number of contacts but was not substantially influenced by either patient age or sex. This lack of association with age was unexpected as with increasing multi-morbidity one would expect greater variability in reason for encounter. Between 5 and 10 consultations, higher entropy was associated with a reduced likelihood of further consultations. In contrast, the occurrence of one or more contacts for a mental health problem was associated with increased likelihood of further consultations.

Conclusion

Complexity of reason for encounter can be estimated in an out of hours primary care setting. Similar levels of statistical complexity are seen in younger and older adults (suggesting that it is more to do with consultation behaviour than morbidity) but it is not a predictor of ongoing high use of urgent care.

Peer Review reports

Background

Managing demand for urgent and unscheduled care is a major problem for health services globally. A particular issue is that some people make heavy use of urgent and unscheduled care both in hospital settings [1, 2] and in primary care [3,4,5]. There are strong similarities in statistical patterns of attendance across these two apparently different settings [6]. Many high users have complex medical and care needs [4, 7,8,9], This complexity may include multiple physical diseases, mental disorders [7, 10] (including health anxiety and substance misuse disorders [11]) and conditions which include both physical and mental components such as persistent physical symptom disorders (also known as “medically unexplained symptoms” or somatoform disorders) [5]. We hypothesised that greater variation in reasons for attending urgent and unscheduled care could be analysed in terms of statistical complexity and might be a useful marker of patients at high risk of ongoing heavy service use.

At present there are no widely used ways of measuring statistical complexity in routinely collected urgent and unscheduled care data. While statistical measures of complexity have been developed for consultations [12] based on the nature of tasks involved and for cases based on co-morbid conditions [13], we are not aware of measures which look at complexity of reason for encounter across multiple episodes of illness or treatment. Based on approaches in information science or ecology, statistical approaches to complexity across multiple illness episodes ought to describe the unpredictability or diversity of reasons for attendance. From this perspective, for a given number of attendances, a more complex case will have more varied reasons for encounter: in contrast a simpler case will have less varied reasons for encounter. This statistical complexity might arise either from multi-morbidity (more different diseases leading to consultation) or from generally increased help seeking (a greater tendency to consult for conditions which might not otherwise lead to urgent care contact). The closest equivalent research relates to studies of continuity of care [14,15,16], where low continuity of care is equivalent to high statistical complexity.

We aimed to estimate the statistical complexity of patients’ reasons for encounter in a large routinely collected dataset of primary care out of hours consultations using a range of different measures. We then aimed to compare these measures and examine their associations with patient characteristics including age, sex, and whether the reasons for encounter included a mental health problem or particular patterns of physical symptoms. Finally, we aimed to examine the predictive value of complexity measures in identifying individuals with a given number of contacts who then went on to have further contacts.

Methods

Data source

We examined a large routinely-collected database of anonymised urgent care use [17, 18] comprising all contacts over one calendar year with NHS24, the primary care out-of-hours (PCOOH) service for the whole of Scotland, United Kingdom (population 5 M). NHS24 provides a range of primary care services, mostly when general practices are closed (typically between 18.00 and 08.00 plus weekends and public holidays) including telephone triage and advice, face to face consultation at designated hubs and home visits by a member of the PCOOH team. It is used by almost all general practices in Scotland. A more detailed description analysis of the service has been published elsewhere [17]. Each contact by a patient with the service was logged (date, time and reason for encounter) and linked to a unique patient identifier. Contacts were allocated a reason for encounter (RfE) by the call-handler from a menu.

The database included all calls made to NHS24 in 2011. For the analysis, we limited the dataset to adults over the age of 18 and to calls made during the out of hours period when normal GP services were closed. While each contact was attributable to a specific patient, the data available did not include patient-identifying information: the only demographic data was the patient age and sex.

Categories of reason for consultation

To provide a manageable number of categories for RfE we mapped all the codes used by call-handlers to one of fourteen categories. These were based on symptoms reported by the patients rather than the ultimate diagnoses. Categories were chosen to cluster together broadly similar items. We used four specific groups of physical symptoms (musculo-skeletal, cardio-respiratory, gastro-intestinal and general / neurological) to map to the body systems used in the bodily distress syndrome (BDS) [19, 20]. We designated these as BDS systems and calculated a score per patient of the number of these systems with at least one RfE. We included these because the presence of BDS features may indicate a more systematic disorder of heightened symptom processing and high healthcare use [21] and because similar disorders have been associated with frequent PCOOH attendance [5]. We included a major illness category for calls specifically about conditions such as cancer or diabetes; however symptomatic episodes of illness such as exacerbations of chronic lung diseases were typically included under their presenting symptom (e.g. cough or breathlessness). The final categorisation was mental health. For the primary analysis we placed calls relating to alcohol and substance misuse in the “other” category, however for a secondary analysis we included them with mental health problems. The full mapping of call-handler codes to symptom categories is shown in Additional file 1: Data 1.

Minimisation of duplicate data

The database contained some instances of multiple calls per episode of care. This could arise, for instance, when a patient called back because a symptom was changing or to confirm that someone was on the way to assess them. For the analysis, we excluded repeated contacts which we defined as relating to the same category and on the same day as another contact.

Threshold for designating “high-use”

We set a threshold for high use of 5 or more contacts in the calendar year. We chose this as representing the best trade-off between a large enough number of contacts to examine heterogeneity and the number of patients who would be included. For the analysis we created four sub-groups based on total number of contacts in the year: 5–10, 11–20, 21–30 and > 30.

Calculation of complexity

We took the idea of measuring complexity from methods developed in information theory and widely used in sciences such as ecology [22]. These methods produce a statistic which represents the amount of information required to describe a feature (whether a sequence of consultations or an ecological habitat).

We calculated four measures of complexity in RfE per patient. First, we used the count of different categories of RfE per patient. While this is easy to estimate, it cannot differentiate between the proportion of contacts which occur in each of the categories represented. Second, we calculated the Herfindahl index, which is an economic tool for measuring market share and represents the sum of the squares of proportion of consultations for each RfE. It is closely related to the Bice-Boxerman index but has the mathematical merit of always scaling between zero and one. Both the Herfindahl and Bice-Boxerman indices have been used in measurement of continuity of care [14, 23]. Third, we estimated Shannon entropy of the proportion of consultations for each RfE: this is a more sophisticated measure of diversity derived from information theory, and is used extensively, for instance in ecology to describe diversity of species in a habitat [22]. We refer to this measure as state entropy because it describes the complexity of the different states, or categories, of RfE but not their sequence. Finally, we estimated Shannon entropy of the transitions between one RfE and the next which we refer to as transition entropy. Formulae for these measures are listed in Additional file 2: Data 2. Table 1 illustrates these measures, using the hypothetical example of four different sequences of 8 contacts for three possible reasons (A, B and C) with calculated values for each of the complexity measures. The count of RfE is unable to differentiate between any of the bottom three rows. While state entropy is able to discriminate between sequences with different proportions of the three RfEs, only transition entropy is able to differentiate between all sequences.

Table 1 example of different complexity measures from an example sequence of reasons for consultation (RfE)

Statistical methods

Complexity measures were estimated using standard formulae implemented in R 3.4.2. We compared the four complexity measures in three ways. First, we plotted histograms of the distribution of values in each of the four subgroups representing different levels of use over the 12 months. Second, we considered the number of contacts needed to reach a relatively stable value by taking a random sample of very high users (over 30 contacts) and plotting the value of the measure over the first N RfEs where N ranged from 5 to 30. Third, we examined the relationship between measures by creating scatterplots and by calculating correlations.

We tested associations of complexity measures with patient demographics and mental health by generating box-plots and by using simple and multiple linear regression. Analysis was carried out on a dataset including all patients. However, to exclude the possibility of our findings being heavily influenced by a few extremely high users, we repeated the analysis, limiting it to patients with between 5 and 30 contacts in the year. We included variables in the multiple regression model if the univariate regression coefficient had a p-value < 0.1 and where testing for variance inflation factor showed low multi-collinearity. We assessed the appropriateness of multiple linear regressions by plotting residuals against a normal distribution.

Finally, we examined whether measures of complexity, estimated after a given number of consultations, were associated with further consultation. We analysed data for patients with at least N1 consultations (where N1 varied between 5 and 15) and used measures of complexity from their first N1 consultations to predict whether they would have N2 consultations (where N2 was either N1 + 1 or N1*1.333). We used logistic regression to examine the effect on further consultation of the following predictors: (a) complexity (as transition entropy of the first N1 contacts, standardised for ease of interpretation) (b) the presence of any mental health RfEs in the first N1 contacts (c) the number of unique RfEs in the first N1 contacts.

Consent and other permissions

All data was anonymised and handled under a data-sharing agreement between the University of Aberdeen and NHS24; as no patient identifiable data was involved, additional research ethical permission was not required.

Results

The database contained 947,814 contacts involving 577,324 adult patients. Of these we excluded 151,995 contacts (95,279 occurred “in hours” rather than during the out of hours period, 38,419 had no problem code entered by the call-handler and 18,297 were related to pregnancy and childbirth). We excluded a further 13,556 duplicate contacts (in the primary analysis, numbers varied in the sensitivity analysis) leaving 782,281 contacts by 507,934 patients. Of these contacts, 120,395 (15.1%) occurred in the 13,981 (2.4%) patients who made 5 or more out of hours contacts.

The high using patients included 8852 women (63.3%) and 5129 men (36.7%). The proportions of female and male high-users was similar to the proportion of women and men among adults who made any contact with the service (62 and 38% respectively). 2635 (18.8%) were aged 18–30; 3185 (22.8%) aged 31–50; 3026 (21.6%) aged 51–70; and 5135 (36.7%) aged over 70. 2708 (19.4%) high-using patients had at least one contact for a mental health problem and 1176 patients (8.4%) had at least one contact specifically about a major illness such as cancer or diabetes. Table 2 shows the distribution of reasons for encounter in both low users and the high users, with the difference in the incidence of RfE categories between the high users and the remaining patients presented as odds ratios. Contacts with high users were relatively more likely to be for mental health reasons (OR = 3.26) and less likely to be for minor conditions such as upper respiratory infections (OR = 0.43) or Skin, Eye and Ear Nose & Throat (ENT) (OR = 0.33).

Table 2 Number (and proportion) of contacts by each reason for encounter in high and low users

Comparison of complexity measures

The distributions of each of the four complexity measures are shown in Fig. 1. Median value (with interquartile range) for the count of RfE categories was 4 (3 to 5); for state entropy it was 1.75 (1.37 to 2) and for transition entropy was 2.0 (1.9 to 2.5). All four measures were closely correlated (allowing for the fact that Herfindahl index is scaled in the opposite direction to the other three measures: high complexity is associated with a lower value) and details of this are shown in Additional file 3: Figure S1. The number of contacts to achieve a relatively stable value is shown in Additional file: 4 Figure S2 – of the four measures, state entropy appears to be the most stable over increasing numbers of contacts.

Fig. 1
figure 1

Distributions of each of the four complexity measures

Based on the information in Fig. 1 and Additional file 3: Figure S1 and Additional file 4: Figure S2, we chose state entropy as the measure of complexity for inclusion in the subsequent analysis.

Relationship of complexity to patient characteristics

Figure 2 shows the relationship of complexity (as state entropy) to patient age group; sex; presence of a mental health contact; and number of BDS systems. In each plot, the complexity increases with number of contacts. Differences in complexity between people with and without a mental health RfE only become apparent in those patients with more than 10 contacts.

Fig. 2
figure 2

Box plots of State Entropy by patient age group, sex, presence of any mental health reason for encounter and by number of bodily distress syndrome categories.BDS: Bodily Distress Syndrome

Table 3 shows the result of univariable regressions of each of the variables as predictors of state entropy. In this analysis, each variable apart from age has a significant association with state entropy. The second and third sections of Table 3 show the coefficients of the multiple linear regression for all high users and then for the subset of patients who had between and 5 and 30 contacts. This shows that the effects of mental health RfE and number of BDS system categories on state entropy were absent or weak after adjusting for other consultation pattern features. Additional file 5: Data 3 includes the histograms of residuals from the two multiple regression models. While these do not fit exactly to a normal distribution, the plot for the subset of patients is relatively symmetrical. Both multiple regression models accounted for a large proportion of the variance in Shannon entropy: adjusted-R2 for the model with all patients was 0.86 and for the patients with < 30 contacts it was 0.92.

Table 3 Simple and multiple regression coefficients for variables associated with State Entropy

Predictive value of complexity of RfE on future contact

Figure 3 shows the influence of selected features (number of RfE, state entropy and having had one or more mental health RfE), on the probability of having one or more additional consultations for each given number of consultations so far. Results are shown as odds ratios with 95% confidence intervals and represent the results of logistic regression, adjusted for age and sex, and limited to patients with at least 2 different RfE in the total period. The figure shows that while the presence of any prior mental health consult is modestly predictive of further consultation (odds ratio between 1.2 and 1.9) at any number of contacts above 5, state entropy is associated with a lower likelihood of further consultations between 5 and 10 contacts. While Fig. 3 shows the effect of predictors on one more consultation, similar patterns are seen when these features are used to predict 33% more consultations (Additional file 6: Figure S3).

Fig. 3
figure 3

Effect of stated features on the probability of one or more further contacts after a given number of contacts (as odds ratio)

Discussion

Summary of main findings

This is the first study to our knowledge to calculate and describe statistical measures of complexity of reasons for encounter with health services. Two measures appeared promising: count of contact categories (which is simple to calculate) and Shannon entropy of RfE categories (which is more difficult to calculate but has better statistical properties). Patient age had only small effects on statistical complexity of reason for encounter suggesting that statistical complexity of urgent care use is more related to healthcare seeking behaviour than to underlying multi-morbidity. Statistical complexity of reason for encounter was not predictive of future consultation, although having attended for a mental health problem was.

Strengths and limitations

This study used a very large and recent dataset of out of hours primary care use which has been validated and analysed in earlier publications [17, 18]. The analysis used a range of techniques for estimating complexity, and the categorisation of physical symptoms followed existing patterns [24]. By considering a range of metrics we were able to choose between them on the basis of their statistical properties and by examining the predictive value of statistical complexity measures for further contact across a range of consultation numbers, we ensured that the results were not sensitive to particular parameters.

The use of patient-initiated reason for consultation was both a strength and a limitation. Its strength was that it reflected patients’ experience of what they perceived to be the problem (or perhaps an appropriate lever to access help). The use of reason for encounter has also been advocated through its inclusion in the International Classification of Primary Care (ICPC-2) [25]. Its limitation is that it made it impossible to distinguish calls due to new incident symptoms from exacerbations of existing conditions in a way that a diagnosis based classification might. This was particularly limiting in the case of mental health conditions as we were only able to identify patients in whom mental health was a reason for encounter, not those in whom it may have been a comorbidity (such as depression) or a contributing factor (such as health anxiety [26] or accompanying a somatoform disorder [5]).

We were limited to only using contacts for unscheduled care during the out-of-hours period because of the data. However, an increasing tendency within UK general practice to facilitate same-day access for all problems would mean that even if such data were available it could not be interpreted. Furthermore we found very similar distributions of contacts per patient between this dataset and 17 other datasets from a range of urgent and unscheduled care settings [6]. The dataset was limited to one calendar year – this was part of the original specification and could not be changed. However, one year is a typical period for studies of attendance.

The analysis posed challenges because of the non-normal distributions of variables – particularly number of contacts [6] and number of different RfE (which were also correlated). Additional file 7: Data 4 describes an additional analysis in which number of contacts was the dependent variable. This uses negative binomial rather than poisson regression as the data were over-dispersed.

The pragmatic nature of the study, using the same data as would be available to PCOOH clinicians rather than a more detailed set of patient characteristics, adds additional constraints. The short length of consultation sequences reduces the accuracy of the statistical analysis and the absence of additional patient data means that other confounders could not be included. However, both these constraints are present in the actual delivery of urgent care services and so if the findings were to be useful they would need to handle this constraint.

Relationship to other research

This is the first study, to our knowledge, which has attempted to measure complexity of reason for consultation in an urgent (out of hours) primary care setting with widely-used metrics from other disciplines. Recent studies from Norway] [27], Denmark [28] and Switzerland [29] have described the distribution of reason for encounter in out of hours primary care, however none have examined the sequence of reasons for encounter in individual patients. While some of the indices (e.g. Herfindal and Bice-Boxerman) have been used on short data sequences [14, 16, 23], others (e.g. Shannon entropy) were designed to use on longer sequences. Our aim in using this metric here was not to produce accurate values for individuals but rather to examine whether an informative signal could be detected in short noisy data sequences.

A number of authors have suggested that approaches derived from the science of complex systems have value in understanding healthcare – both qualitatively [30, 31] and quantitatively. In this study we have used the principle of measuring statistical complexity as a way of reproducibly describing consultation sequences as more or less complex.

Implications for policy, practice and research

The first implication of our findings is that statistical complexity in reason for encounter does not increase with age. At first this appears unintuitive – as patients become older and develop more illnesses one should expect that the number and variety of reasons for encounter should increase. We propose two explanations for this finding. The first is that even where there is multi-morbidity, patients may have one dominant symptom which acts as a common pathway (for instance a patient with chronic lung disease may seek help for breathlessness even if the “trigger” is a respiratory infection or increased anxiety). The second is that patients may have a “natural threshold” for seeking help and whenever this is crossed – for whatever reason – it results in a contact. Some patients with mental health problems – particularly anxiety - may have lower thresholds [26]. The presence of high complexity in RfE, particularly in a younger adult, may be a useful indicator of concurrent anxiety.

In terms of predicting future contact, however, the complexity measures were uninformative. More predictive, was the presence of an explicit mental health problem in any of the previous consultation. Such problems are likely to include both severe mental illness and episodes of mental health crisis.

Conclusion

Complexity of reason for encounter can be estimated in an out of hours primary care setting. While similar levels of complexity are seen in younger and older patients (suggesting that it is more to do with consultation behaviour than morbidity and may be a marker of health anxiety or somatoform disorder), it is not in itself a predictor of ongoing high use of urgent care.

Abbreviations

BDS:

Bodily distress syndrome

ENT:

Ear, Nose and Throat

ICPC-2:

International Classification of Primary Care – 2nd Edition

PCOOH:

Primary care out-of-hours

RfE:

Reason for encounter

References

  1. Mason SM. Frequent attendance at the emergency department is a symptom but not a disease. Emerg Med J. 2014;31(7):524–5.

    Article  Google Scholar 

  2. Pines JM, Asplin BR, Kaji AH, Lowe RA, Magid DJ, Raven M, et al. Frequent users of emergency department services: gaps in knowledge and a proposed research agenda. Acad Emerg Med. 2011;18(6):e64–9.

    Article  Google Scholar 

  3. Buja A, Toffanin R, Rigon S, Sandona P, Carraro D, Damiani G, et al. Out-of-hours primary care services: demands and patient referral patterns in a Veneto region (Italy) local health authority. Health Policy (Amsterdam, Netherlands). 2015;119(4):437–46.

    Article  Google Scholar 

  4. Sandvik H, Hunskaar S. Frequent attenders at primary care out-of-hours services: a registry-based observational study in Norway. BMC Health Serv Res. 2018;18(1):492.

    Article  Google Scholar 

  5. Leutgeb R, Berger S, Szecsenyi J, Laux G. Patients with somatoform disorders: more frequent attendance and higher utilization in primary out-of-hours care? PLoS One. 2018;13(8):e0202546.

    Article  Google Scholar 

  6. Burton C, Elliott A, Cochran A, Love T. Do healthcare services behave as complex systems? Analysis of patterns of attendance and implications for service delivery. BMC Med. 2018;16(1):138.

    Article  Google Scholar 

  7. Moore L, Deehan A, Seed P, Jones R. Characteristics of frequent attenders in an emergency department: analysis of 1-year attendance data. Emerg Med J: EMJ. 2009;26(4):263–7.

    Article  CAS  Google Scholar 

  8. Billings J, Raven MC. Dispelling an urban legend: frequent emergency department users have substantial burden of disease. Health Aff. 2013;32(12):2099–108.

    Article  Google Scholar 

  9. Capp R, Rosenthal MS, Desai MM, Kelley L, Borgstrom C, Cobbs-Lomax DL, et al. Characteristics of Medicaid enrollees with frequent ED use. Am J Emerg Med. 2013;31(9):1333–7.

    Article  Google Scholar 

  10. Minassian A, Vilke GM, Wilson MP. Frequent emergency department visits are more prevalent in psychiatric, alcohol abuse, and dual diagnosis conditions than in chronic viral illnesses such as hepatitis and human immunodeficiency virus. J Emerg Med. 2013;45(4):520–5.

    Article  Google Scholar 

  11. Liu SW, Nagurney JT, Chang Y, Parry BA, Smulowitz P, Atlas SJ. Frequent ED users: are most visits for mental health, alcohol, and drug-related complaints? Am J Emerg Med. 2013;31(10):1512–5.

    Article  Google Scholar 

  12. Islam R, Weir C, Fiol GD. Clinical complexity in medicine: a measurement model of task and patient complexity. Methods Inf Med. 2016;55(1):14–22.

    Article  CAS  Google Scholar 

  13. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Clin Epidemiol. 1987;40(5):373–83.

    CAS  Google Scholar 

  14. Pollack CE, Hussey PS, Rudin RS, Fox DS, Lai J, Schneider EC. Measuring care continuity: a comparison of claims-based methods. Med Care. 2016;54(5):e30–4.

    Article  Google Scholar 

  15. Kern LM, Seirup JK, Casalino LP, Safford MM. Healthcare fragmentation and the frequency of radiology and other diagnostic tests: a cross-sectional study. J Gen Intern Med. 2017;32(2):175–81.

    Article  Google Scholar 

  16. Tammes P, Purdy S, Salisbury C, MacKichan F, Lasserson D, Morris RW. Continuity of primary care and emergency hospital admissions among older patients in England. Ann Fam Med. 2017;15(6):515–22.

    Article  Google Scholar 

  17. McAteer A, Hannaford PC, Heaney D, Ritchie LD, Elliott AM. Investigating the public's use of Scotland's primary care telephone advice service (NHS 24): a population-based cross-sectional study. Br J Gen Pract. 2016;66(646):e337–46.

    Article  Google Scholar 

  18. Elliott AM, McAteer A, Heaney D, Ritchie LD, Hannaford PC. Examining the role of Scotland's telephone advice service (NHS 24) for managing health in the community: analysis of routinely collected NHS 24 data. BMJ Open. 2015;5(8):e007293.

    Article  Google Scholar 

  19. Fink P, Schroder A. One single diagnosis, bodily distress syndrome, succeeded to capture 10 diagnostic categories of functional somatic syndromes and somatoform disorders. J Psychosom Res. 2010;68(5):415–26.

    Article  Google Scholar 

  20. Budtz-Lilly A, Vestergaard M, Fink P, Carlsen AH, Rosendal M. Patient characteristics and frequency of bodily distress syndrome in primary care: a cross-sectional study. Br J Gen Pract. 2015;65(638):e617–23.

    Article  Google Scholar 

  21. Rosendal M, Olde Hartman TC, Aamland A, van der Horst H, Lucassen P, Budtz-Lilly A, et al. Medically unexplained symptoms and symptom disorders in primary care: prognosis-based recognition and classification. BMC Fam Pract. 2017;18(1):18.

    Article  Google Scholar 

  22. Ricotta C, Szeidl L. Towards a unifying approach to diversity measures: bridging the gap between the Shannon entropy and Rao's quadratic index. Theor Popul Biol. 2006;70(3):237–43.

    Article  Google Scholar 

  23. Maarsingh OR, Henry Y, van de Ven PM, Deeg DJ. Continuity of care in primary care and association with survival in older people: a 17-year prospective cohort study. Br J Gen Pract. 2016;66(649):e531–9.

    Article  Google Scholar 

  24. Budtz-Lilly A, Fink P, Ornbol E, Vestergaard M, Moth G, Christensen KS, et al. A new questionnaire to identify bodily distress in primary care: the 'BDS checklist. J Psychosom Res. 2015;78(6):536–45.

    Article  Google Scholar 

  25. Verbeke M, Schrans D, Deroose S, De Maeseneer J. The international classification of primary care (ICPC-2): an essential tool in the EPR of the GP. Stud Health Technol Inform. 2006;124:809–14.

    PubMed  Google Scholar 

  26. Patel S, Kai J, Atha C, Avery A, Guo B, James M, et al. Clinical characteristics of persistent frequent attenders in primary care: case-control study. Fam Pract. 2015;32(6):624–30.

    PubMed  PubMed Central  Google Scholar 

  27. Raknes G, Hunskaar S. Reasons for encounter by different levels of urgency in out-of-hours emergency primary health care in Norway: a cross sectional study. BMC Emerg Med. 2017;17(1):19.

    Article  Google Scholar 

  28. Moth G, Huibers L, Christensen MB, Vedsted P. Out-of-hours primary care: a population-based study of the diagnostic scope of telephone contacts. Fam Pract. 2016;33(5):504–9.

    Article  Google Scholar 

  29. Huber CA, Rosemann T, Zoller M, Eichler K, Senn O. Out-of-hours demand in primary care: frequency, mode of contact and reasons for encounter in Switzerland. J Eval Clin Pract. 2011;17(1):174–9.

    Article  Google Scholar 

  30. Love T, Burton C. General practice as a complex system: a novel analysis of consultation data. Fam Pract. 2005;22(Generic):347–52.

    Article  Google Scholar 

  31. McDaniel RR Jr, Driebe DJ, Lanham HJ. Health care organizations as complex systems: new perspectives on design and management. Adv Health Care Manag. 2013;15:3–26.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was carried out without external funding.

Availability of data and materials

The permissions granted us for the dataset do not permit data sharing.

Author information

Authors and Affiliations

Authors

Contributions

The study was conceived by CB and AE and developed jointly with SS. AE was responsible for primary data provision and preparation; SS and CB conducted the primary analysis. All authors contributed to the writing and revision of the manuscript and approve its content. CB is guarantor for the study. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Christopher Burton.

Ethics declarations

Ethics approval and consent to participate

This study used anonymised routine data. The Primary Care Out of Hours data was handled under a data-sharing agreement between the University of Aberdeen and NHS24; as no patient identifiable data was involved, additional research ethical permission was not required.

Consent for publication

Not applicable.

Competing interests

All authors have completed the ICMJE uniform disclosure form at http://www.icmje.org/conflicts-of-interest/ and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Data 1. Mapping of codes from original data to categories. (DOCX 16 kb)

Additional file 2:

Data 2. Formulae for calculation of statistical measures of complexity. (DOCX 13 kb)

Additional file 3:

Figure S1. Correlation plots of complexity measures (JPEG 356 kb)

Additional file 4:

Figure S2. Complexity measures for individual patients with increasing number of contacts (limited to patients with > 20 contacts). (JPEG 832 kb)

Additional file 5:

Data 3. Histograms of standardised residuals from regression models for different subgroups of patients. (DOCX 157 kb)

Additional file 6:

Figure S3. Odds ratio for at least 33% more consultations based on predictors at the time of Nth consultation. (JPEG 414 kb)

Additional file 7:

Data 4 - Negative binomial regression with total number of contacts as the dependent variable. (DOCX 14 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stegink, S., Elliott, A.M. & Burton, C. Statistical complexity of reasons for encounter in high users of out of hours primary care: analysis of a national service. BMC Health Serv Res 19, 108 (2019). https://doi.org/10.1186/s12913-019-3938-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-019-3938-z

Keywords