- Research
- Open access
- Published:
Data completeness and consistency in individual medical records of institutional births: retrospective crossectional study from Northwest Ethiopia, 2022
BMC Health Services Research volume 23, Article number: 1189 (2023)
Abstract
Background
Ensuring the data quality of Individual Medical Records becomes a crucial strategy in mitigating maternal and newborn morbidity and mortality during and around childbirth. However, previous research in Ethiopia primarily focused on studying data quality of institutional birth at the facility level, overlooking the data quality within Individual Medical Records. This study examined the data completeness and consistency within Individual Medical Records of the institutional birth service and associated factors.
Methods
An institution-based retrospective cross-sectional study was conducted in two districts of Northwest Ethiopia. Data were obtained by reviewing three sets of Individual Medical Records of 651 women: the delivery register, Integrated Individual Folder, and integrated card. The proportions of completeness and consistency were computed. A multilevel binary logistic regression was used to identify factors of completeness and consistency. An odds ratio with a 95% confidence interval was used to assess the level of significance.
Results
Overall, 74.0% of women’s Individual Medical Records demonstrated good data completeness ( > = 70%), 95%CI (70.5, 77.3), while 26% exhibited good consistency, 95%CI (22.9, 29.7). The presence of trained providers in data quality (AOR = 2.9, 95%CI: (1.5, 5.7)) and supportive supervision (AOR = 11.5, 95%CI: (4.8, 27.2)) were found to be associated with completeness. Health facilities’ practice of root cause analysis on data quality gaps (AOR = 8.7, 9%CI: (1.5, 50.9)) was statistically significantly associated with the consistency.
Conclusions
Most medical records were found to have good completeness, but nearly only a quarter of them found to contain consistent data. Completeness and consistency varied on the type of medical record. Health facility’s root cause analysis of data quality gaps, the presence of trained providers in data quality, and supportive supervision from higher officials were identified as factors affecting data quality in institutional birth service. These results emphasize the importance of focused efforts to enhance data completeness and consistency within Individual Medical Records, particularly through consideration of Individual Medical Records in future provider training, supervision, and the implementation of root cause analysis practices.
Background
Poor healthcare quality during and around the time of birth in healthcare facilities becomes a paramount contributor to the persistence of maternal and newborn morbidity and mortality [1]. Quality medical records are emphasized among crucial approaches in improving the quality of care during this critical period [2]. Maintaining quality Individual Medical Records (IMRs) for women is pivotal [3], as these records facilitate early detection and effective management of pregnancy-related complications [4,5,6]. The World Health Organization (WHO) underscores the importance of quality medical records during and around pregnancy, stating, “Every woman and newborn has a complete, accurate, standardized medical record during labour, childbirth, and the early postnatal period [7].” Quality IMRs also hold a vital role in ensuring the continuity of health services throughout pre-pregnancy to postnatal care [8,9,10,11,12]. They surpass providers’ memory [13], serving as the principal repository of historical health information, thus enhancing patient care quality [14].
In evaluating medical record data quality, two vital dimensions are completeness and consistency [15]. Completeness measures missing data in a dataset [16], while consistency assesses agreement of data across sources like departments, databases, times, or locations [17].
Prior research findings on institutional birth data quality have shown varying levels of completeness and consistency. Studies in India, Ghana, and Ethiopia showed good completeness in institutional birth records, ranging from 75 to 95% [2, 18,19,20]. Conversely, research in Iraq, Indonesia, and West Africa revealed lower completeness rates, ranging between 22% and 25% [21,22,23]. Regarding consistency, a study in Rwanda reported a high (98%) consistency rate when comparing institutional birth reports to facility registers [24]. Some studies from Ethiopia demonstrated that institutional birth data consistency ranges from 66 to 97% [25, 26].
In Ethiopia, though prior research has examined the completeness and consistency of institutional birth data, it has predominantly concentrated on evaluating restricted data sources. Completeness was often evaluated in limited medical records like delivery registers [19, 27]. Some studies assessed the completeness of content in reports [28, 29]. Likewise, consistency measurement was frequently involved in comparing aggregate data among the report and recount from the delivery register [25, 26]. Previous studies have not sufficiently addressed the data quality of IMRs in institutional birth. Hence, this study evaluated the IMRs of institutional birth data in two districts in Northwest Ethiopia, aiming to answer the following questions: (1) How is the completeness and consistency of data within IMRs of institutional birth? (2) What factors are associated with the completeness and consistency of data within IMRs of institutional birth?
Methods
Study setting
This study was conducted in the “Wegera” and “Tach-armachiho” districts of Central Gondar Zone, Amhara National Regional State, Northwest Ethiopia. The capital of “Wegera” district, “Amba-Giorgis,” is located 232 km from Bahirdar, the capital city of Amhara National Regional State, while the capital of “Tach-armachiho,” “Sanja,” is 298 km from Bahirdar [30]. In 2021, the total population in the two districts was 398,350 [31]. The population of women in reproductive age was estimated at 93,214 (23.4%) [32]. Two primary hospitals, 13 health centers, and 72 health posts provide comprehensive health services for the two districts’ population.
The study sites were chosen through a joint decision involving the Central Gondar Zone, Amhara Region Health Bureau, and the University of Gondar. Both districts are currently participating in the Capacity Building and Mentoring Partnership (CBMP) program, in collaboration with the Ethiopian Ministry of Health(FMOH) and the University of Gondar, aimed at enhancing health data quality and utilization [33]. The University of Gondar offers technical support, including training, supervision, and mentorship, to local health facilities as part of CBMP intervention [34].
Existing institutional birth data management
Ethiopia is implementing the routine Health Management Information System (HMIS), which has been in place since 2008 [35]. The HMIS was revised in 2017 to enhance the monitoring of priority health outcomes [36]. Institutional birth is a core indicator of the revised HMIS and Ethiopia’s Health Sector Transformation Plan (HSTP-II), guiding decision-making across all healthcare system levels to mitigate the country’s persistent maternal and newborn mortality challenges [37]. In Ethiopian HMIS, the data source for institutional birth coverage is mainly from governmental institution-based medical records [38]. According to the Ethiopian data recording and reporting procedures guideline [39], the central medical records designed for the documentation of institutional birth service are three: (1) The delivery register, (2) The women’s Integrated Individual Folder (IIF), and (3) the ‘Integrated Antenatal, Delivery, Newborn, and Postnatal Care Card’ – the integrated card hereafter.
The delivery register captures data for each woman giving birth, including identification, services received, and health outcomes for both mother and newborn. Each row in the delivery register corresponds to the data of a particular woman who has given birth at healthcare facilities. It is typically stored in the Maternal and Child Health Department (MCH), where institutional birth occurs. The Integrated Individual Folder serves to record mainly the women’s identity details and other socio-demographic variables of women. It also functions as a pouch to contain all other IMRs of women, including the integrated card. The integrated card gathers data for women throughout Ante Natal Care (ANC), intrapartum, labor, delivery, and Post Natal Care (PNC).
Both the IIF and integrated card are archived in the Medical Record Unit(MRU). After data capture by providers at the MCH, the integrated card must be promptly filed within the women’s IIF at the MRU [39].
Study design and period
An institution-based retrospective cross-sectional survey was done to examine the completeness and consistency of the IMRs pertaining to institutional birth. The data collection for this study was done in late December 2021 for 12 days (17–28/December 2021).
Study subjects and sample size
The study subjects of this study consisted of the three pairs of IMRs(the delivery register, IIF, and the integrated card) of women who gave birth within the six months preceding the survey. These three sets of IMRs were paired together using the mother’s Medical Record Number (MRN) to form a single study subject.
The required sample size was determined using a single population proportion formula:
Where n = the initial sample size.
zα/2= reliability coefficient at 95% confidence level = 1.96, (zα/2)2 = 3.8416.
p = proportion of outcomes (data completeness and consistency).
q = 1-p.
d = margin of error = 0.05, and thus d2 = 0.0025.
Considering completeness and consistency as this study’s outcomes, we have 80.3% completeness and 29.5% consistency, obtained from a pilot study conducted prior to this main study in the “Gondar zuria” district, Northwest Ethiopia. These proportions were assumed to compute the required sample, with additional assumptions of a design effect of 2 and a 10% non-response rate. The computed sample sizes were: ≈535 based on the completeness proportion and ≈ 703 based on the consistency proportion. Consequently, the largest sample size of 703, which was computed using the proportion of consistency, was used for this study.
Sampling procedure
The “Wegera” and “Tach-armacheho”districts had eight and five health centers, respectively. We selected six health centers in “Wegera” and five(all) in “Tach-armacheho” districts, giving a total of eleven health centers. The samples in this study were selected from a list of entries(rows) in the delivery register. Six months before the survey date, we identified 1199 entries of women who had delivered at the selected health centers in the two districts. The inclusion criteria for selecting the study subjects was the readability of women’s MRN in the delivery register. According to the guideline [39], each woman would have a unique MRN to facilitate the identification and matching of IMRs. Therefore, women’s entries with readable MRNs were necessary to match the three sets of IMRs targeted by this study. Accordingly, of the 1199 women’s entries on the delivery register,1175 had readable MRNs. These 1175 entries of women were used as a sampling frame, and samples were selected using Stratified Random Sampling (Fig. 1).
Variables and measurement
Outcome variables
Completeness
This study adopted a completeness definition proposed in previous study [17], where completeness refers to the presence of all required data elements in a target dataset. Thus, we assessed completeness by reviewing the presence of data elements that are expected to be contained in the delivery register, IIF, and integrated card. Of the data elements on these IMRs, completeness was determined for data elements mandatory for recording. The IMRs considered in this study did not require obligatory recording for some data elements. For instance, we excluded the mother’s HIV test from the completeness assessment since incomplete HIV data could be due to the absence of HIV services, rather than missing information. Incomplete data may not imply missing; that missing could simply result from an event that did not occur, as indicated by some previous studies [40]. Such data elements were not included to measure completeness in this study. Accordingly, completeness was analyzed for 33 variables in total. Of the 33 variables, 10 were from the delivery register, 7 were from the IIF, and 16 were from the integrated card.
Consistency
We evaluated consistency by cross-checking the data element’s agreement across the IMRs [41]. The data elements documented in the delivery register were verified for agreement with both the IIF and the integrated card. The delivery register was considered the gold standard due to its inclusion of a comprehensive set of shared data elements, allowing for comparison with the IIF and integrated card. Accordingly, two data elements, a “serial number” and “date of delivery,“ were extracted from the delivery register and compared to the data fields in the woman’s IIF. To examine the consistency between the delivery register and the integrated card, we compared the IMRs of women on 11 data elements (“MRN”, “name of mother”, “date of delivery”, “time of delivery ”, “mode of delivery”, “sex of newborn”, “name and signature of provider”, “Apgar score”, “newborn weight”, “women’s HIV test accepted”, and “women’s HIV test result”).
Independent variables
We measured and incorporated the following independent variables in our analysis to identify factors associated with the completeness and consistency of data within IMRs:
The presence of health information technology (HIT)
This variable determined the existence of a designated person responsible for institutional birth data entry and report compilation, coded as ‘1’ (‘Yes’) for presence and ‘0’ (‘No’) for absence.
Availability of data recording tools
Assessed the availability of HMIS data recording tools over six months, coded ‘1’ (‘Yes’) for uniform availability throughout the six months and ‘0’ (‘Partially available’) otherwise.
Availability of trained providers
Measured staff training on institutional birth data review and quality, coded ‘1’ (‘Mostly trained’) if all staff has received training in the past six months and ‘0’ (‘Partially trained’) if some staff have received training in the past six months.
Supportive supervisions from higher officials
Measured the extent of supportive supervision from higher-level officials over the past six months before the survey, coded ‘1’ (‘At least three times’) for at least three visits and ‘0’ (‘Less than three times’) for fewer.
Existence of Performance Monitoring Team(PMT)
Determined PMT establishment, coded ‘1’ (‘Yes’) for presence and ‘0’ (‘No’) for absence.
The PMT per membership standard
Assessed PMT members composition, coded ‘1’ (‘Yes’) for standard membership composition (the team comprised of the Head of the institution, HMIS in charge, and all representatives of the case teams) and ‘0’ (‘No’) otherwise.
Monthly PMT meeting in the last 6 months
Measured monthly PMT meetings supported with minutes, coded ‘1’ (‘Yes’) for regularity (conducted each month) and ‘0’ (‘No’) otherwise.
Monthly conducted lot quality assurance sampling (LQAS) in the last 6 months
Evaluated monthly LQAS reviews supported with minutes, coded ‘1’ (‘Yes’) for regularity (conducted each month) and ‘0’ (‘No’) otherwise.
Conducted Root Cause Analysis (RCA) on identified gap
Determined RCA performance on the identified data quality gaps, coded ‘1’ (‘Yes’) for conducted RCA and ‘0’ (‘No’) for absence.
Internal supervisions
Measured internal supervisory visits by the management of the health facilities, coded ‘1’ (‘At least two times’) for at least two visits and ‘0’ (‘Less than two times’) for fewer.
Availability of HMIS guidelines
Assessed guideline presence, coded ‘1’ (‘Yes’) for all guidelines available (Health Data quality, HMIS Procedure manual, Indicator reference manual, and Information Use manual) and ‘0’ (‘Partially available’) for any missing guideline.
Data collection
The IMRs were reviewed using a checklist developed by researchers in this study (Supplementary 1). A checklist was prepared following pertinent Routine Health Information System(RHIS) literature, including the Performance of Routine Information System Management (PRISM) framework [42, 43] and Ethiopian HMIS-related guidelines [36, 39, 44]. A checklist was piloted in the “Gondar Zuria” district on 78 study participants (11% of the study sample). Cronbach's alpha was computed to evaluate the internal consistency reliability of the items of the outcome variables, revealing a better reliability of 0.86. Eleven data collectors, including HIT personnel and relevant health sciences graduates, were recruited to collect the data. Data collectors were recruited from district health offices and local health facilities within the study sites. The data collectors received three days of training regarding the study's objectives, methodologies, and ethical considerations. The principal investigator and the other two deployed supervisors closely supervised the entire data collection.
Data analysis
Data were entered into Epi-data v-3.1 and analyzed using the statistical software Stata v-17.0. We calculated the frequency and percentage of completeness and consistency for data elements and IMR type.
Concerning completeness, each data element was coded as 1"Yes" if recorded and 0"No" if unrecorded for each study subject. The completeness proportion was determined for data elements by dividing the total number of study subjects with recorded data elements by the total sample size. The mean completeness rates were separately computed for the three IMRs by adding the count of recorded data elements for each study subject and then dividing it by the respective total expected number of data elements. The overall average completeness proportion was determined by summing the recorded data elements per study subject and dividing this sum by 33(the total expected number of data elements across the three IMRs).
Similarly, for consistency, data elements were coded as 1"Yes" if consistently recorded and 0"No" if not consistently recorded. The consistency proportion per data element was calculated by dividing the sum of subjects with consistent data elements by the total sample. The average consistency rate was calculated by adding up the number of consistently recorded data elements per woman's IMRs and dividing it by the total number of expected data elements.
We applied the WHO's minimum acceptable data quality threshold of 70% [45] to categorize completeness and consistency as "Good" or "Poor." As a result, we categorized completeness as "Good" if the set of IMRs had 70% or more complete data and as "Poor" otherwise. Similarly, we categorized consistency as "Good" if the set of IMRs contained 70% or more consistent data and as "Poor" otherwise.
Multilevel logistic regression analysis
Our outcome variables, completeness and consistency, were defined at level one, at the level of the study subjects (pairs of women's IMR). Given that study subjects are nested within the health centers they belong to, we assume more similarities among subjects within the same health center regarding this study's outcome variables. The intra-class correlation coefficients (ICC) were calculated to determine the degree of similarity of study subjects within health centers (clusters) [46, 47]. Unlike outcome variables, all the independent variables in our study were measured at the health center's level (level two). However, owing to the flexibility inherent in multilevel modeling [47], we employed a disaggregation approach to assign values of independent variables to each study unit for the multilevel regression analysis.
Accordingly, to examine the association between the independent variables and outcome variables, a multilevel (two level) binary logistic regression model was employed. We computed crude and adjusted Odds Ratios using two-level binary logistic regression and considered a corresponding 95% CI to determine the statistical significance and precision of the point estimate. Hosmer-Lemeshow goodness fit statistic was used for the model fitness [48]. Variance Inflation Factor (VIF) was used to assess multicollinearity, and VIF > 5 was considered to declare the multicollinearity of the independent variables [49]. To address multicollinearity, some independent variables were excluded from the final model. Receiver-operating characteristics (ROC) were calculated to measure the discriminative power of the models [50].
Results
Description of women’s IMRs by health facilities characteristics
Data analysis was performed on 651 (92.6%) study subjects with three IMR types: delivery register, integrated card, and IIF. The distribution of study subjects was similar across most of the health facilities’ characteristics. Frequency variations were observed with the following variables: the presence of trained providers in data quality, availability of the data recording tools, number of supportive supervisions from the higher officials, availability of HMIS guidelines, performance of internal supervision, and health facilities’ RCA on data quality gaps.
The majority,598(91.9%) of the IMRs were from health centers with HMIS guidelines. More than half, 452(69.4%) of the IMRs were from the health centers where most providers received training on data quality. Less than half, 293(45.0%) of IMRs were from the health centers where the data recording tools partially existed. Nearly half, 330(50.7%) of the IMRs were from health centers with at least three supportive supervision visits from higher officials six months before the study period (Table 1).
Completeness of institutional birth data
Average completeness rate by type of IMRs
On average, the delivery register contained 94.2% complete data, 95%CI (93.0, 94.1). In comparison, integrated cards contained 72.9% complete data (95% CI: 70.1, 75.9), and the IIF showed the lowest completeness score at 52.5% (95% CI: 50.5, 54.1). The mean completeness rate across the three IMRs was 78.1%, 95%CI (76.5, 79.8). The data completeness for 74.0% of IMRs was good ( > = 70%), 95%CI (70.5, 77.3) (Fig. 2).
Completeness of the specific institutional birth data elements
Regarding the data elements in the delivery register, the “Serial Number” was completely recorded for all study subjects. Except for the “name and signature of providers,” showed 78.9% completeness (95% CI: 75.8, 82.1), and the “time of delivery” showed 64.1% completeness (95% CI: 60.4, 67.8), all other variables in the delivery register showed completeness rates over 90%.
The “Serial Number” in the IIF showed a completeness rate of 9.5% (95% CI: 7.30, 11.8). In the IIF, the lowest completeness rates were observed for two other variables: the “name of the department” with 9.8%(95% CI: 7.50, 12.1) and the “date of delivery” with 9.7% (95% CI: 7.40, 11.9). However, it was found that the completeness rates for the remaining data elements in the IIF exceeded 76%.
Concerning the data elements from the Integrated Card, this study revealed completeness rates ranged from 57.1 to 78.9%. While “Name of Mother” and “Gravida” showed completeness rates of 78.9%(95% CI: 75.8, 82.1) and 72.6%(95% CI: 69.2, 76.1) respectively, “Ruptured Membranes” was recorded at a lower rate of 57.1%(95% CI: 53.3, 60.9) (Table 2).
Consistency of institutional birth data across IMRs
The average consistency among IMRs was estimated at 55.2%, 95%CI (53.2, 57.2). Twenty- six percent of IMRs exhibited good consistency ( > = 70%), 95%CI (22.9, 29.7).
Among the delivery register and IIF, the “Serial number” demonstrated a consistency rate of 4.8% (95% CI: 3.10, 6.40), while the “Date of delivery” exhibited a consistency rate of 6.7% (95% CI: 4.70, 8.60).
Across the comparison between the delivery register and integrated card, the consistency rates varied for different variables: “Newborn weight” showed a high consistency rate of 80.7% (95% CI: 77.6, 83.7), the “name and signature of provider” had a consistency rate of 56.1% (95% CI: 52.2, 59.9), “Time of delivery” was consistently recorded in 44.1% of records (95% CI: 40.3, 47.9), while just 23.5% of records displayed consistent HIV testing acceptance of women (95% CI: 20.3, 26.8) (Table 3).
Factors associated with completeness and consistency of institutional birth data
In multilevel binary logistic regression, after adjusting for other factors, health facilities with mostly trained providers showed a 2.9-fold increase (AOR = 2.9, 95% CI: 1.5, 5.7) in the likelihood of containing good complete data recording compared to those with partially trained providers. Similarly, health facilities with at least three times SS were associated with a 11.5-fold increase (AOR = 11.5, 95% CI: 4.8, 27.2) in chance of IMRs containing good data completeness compared to those with less than three times SS. (Table 4).
The IMRs from health facilities that conducted the RCA on data quality gaps demonstrated about ninefold higher chance (AOR = 8.7, (95% CI: 1.5, 50.9)) of good consistency compared to IMRs from facilities that did not engage in the RCA practice (Table 5).
In the null model (model without independent variables), the variances for completeness and consistency across health centers were estimated at 2.37 and 2.69, respectively. These variance estimates produced an ICC of 0.42 for completeness and 0.45 for consistency. The ICC results showed that variations across health centers explained 42% of the variation in odds of completeness and 45% of the variation in consistency. However, a reduction in ICC was observed when comparing the final models to the null models, with the ICC for completeness decreasing from 42% to nearly 0% and the ICC for consistency decreasing from 45–25% (Table 6).
Discussion
This research examined the completeness and consistency of data within IMRs of institutional birth and associated factors. On average, over three-fourths of the pairs of IMRs were complete, and over half were consistent. The presence of trained providers in data quality and support and supervision from higher officials were the identified statistically significant factors of good data completeness. Health facilities’ RCA on data quality gaps was identified as a predictor of good consistency.
Our study found a mean completeness rate of 78% across three IMRs. This result aligns with previous research in Ethiopia [27], which reported a 78% completeness rate for institutional birth records. Our study’s findings exceed those from a study in Ghana [20] and Tanzania [51], which reported 75% and 68% completeness rates, respectively. Moreover, our result is far higher than that of a study conducted in Southern Ethiopia [52], which reported a completeness rate of only 18.4%. This difference indicates the variability in the completeness of IMR data across contexts and types of health institutions. Our study, specifically focused on data completeness within the context of health centers, may reflect a distinct result compared to the Tanzanian and Southern Ethiopian studies that assessed IMRs within hospital settings. The varying completeness levels observed across different healthcare settings underscore the need to tailor the data completeness enhancement strategies to each healthcare context.
Nonetheless, our study’s finding on completeness is lower than that in Northern Ethiopia, which showed 95% completeness [19]. The discrepancy in findings may be attributed to differences in sample sizes and the range of variables examined among these studies. Notably, our study involved a remarkably larger sample of IMRs compared to the Northern Ethiopian study, which reviewed just 50 records. Besides, our research comprehensively assessed completeness across various data elements within different IMRs. The lower completeness rate identified in our study compared to the previous study implies the need for further efforts to enhance data completeness in institutional birth. Our study suggests the inclusion of thorough IMR assessments in future policies and practices for the betterment of institutional birth and the broader scope of RHIS data quality [53,54,55].
In this study, the data consistency among IMRs averaged 56%, and only 26% demonstrated good consistency ( > = 70%). These findings deviate from previous studies on the consistency of institutional birth data, as a report from Rwanda [24] indicated a consistency rate of 98%, whereas a study in Southern Ethiopia [25] reported a consistency rate of 96.9%. The disparity in results could result from differences in the approaches used to measure consistency. Previous studies employed the Verification Factor (VF), which involved comparing institutional birth reports with data recounted from the source documents [45]. In contrast, our study compared specific data elements across women’s IMRs. While the conventional VF approach provides valuable insights into data quality at aggregated levels (at the health facility and above levels) [45], understanding data quality within women’s IMRs is vital for delivering high-quality care to individual client’s level [56]. Hence, our study calls for further enhancements of institutional birth data quality and emphasizes the need for a detailed consistency assessment across women’s IMRs [41, 57,58,59]. Improving data quality in women’s IMRs can greatly assist healthcare providers in identifying and addressing pregnancy-related causes of death, which is vital in reducing maternal and neonatal mortality through effective data utilization [7].
This study revealed that types of IMRs and data elements varied in completeness and consistency. Notably, most women’s IIF lacked quality recording of critical variables, including the “serial number,“ “name of the department,“ and “date of delivery.“ Since these variables were initially intended to guarantee continuity of care throughout pregnancy and childbirth [39], their incomplete and inconsistent recording raises concerns about the quality of maternity care at healthcare facilities. For policymakers and practitioners, our findings emphasize the need to implement strategies that enhance the accurate recording of these essential variables to improve the continuity and quality of pregnancy-related care. Besides, despite some prior research indicating variations in the quality across variables within medical records [60], the reasons behind the lack of quality recording of such essential variables still need to be clarified. Hence, future research needs to prioritize conducting thorough investigations to gain insights into the factors behind variations in data quality across different IMRs and data elements.
This study’s findings revealed a higher likelihood of good completeness in IMRs when facilities are mostly staffed by trained providers in data quality. This finding aligns with a previous study conducted in Ethiopia, which identified a significant association between training and data quality [61, 62]. Regular training is widely acknowledged as a key factor in enhancing providers’ motivation and competence for better performance in data quality and the range of maternity services quality at health facilities [63, 64].
Our study revealed that supportive supervision by higher-level officials is another significant factor linked to the good completeness of data in institutional birth. This finding is consistent with prior studies conducted in Ethiopia and Indonesia [65, 66], which highlighted the effectiveness of supportive supervision in improving health care data quality. Therefore, Policymakers, program managers, and officials at the district and higher administrative levels need to prioritize strengthening regular supervision and directives for healthcare facilities, enabling healthcare providers to promptly identify and correct data quality gaps in the services they deliver [67].
In contrast to data completeness, this study revealed that training and supportive supervision were not significantly associated with data consistency within IMRs of institutional birth. This study’s contrast with previous findings [62, 63, 68] underscores the importance of tailoring data quality improvement efforts in RHIS to address the specific challenges within IMRs. Policymakers and program managers need to consider incorporating IMR-specific training and support into future initiatives to enhance the data quality of institutional birth.
In this study, conducting RCA to address identified data quality gaps was found to have a positive association with the good consistency of institutional birth data.Prior studies have reported the effectiveness of routine data quality evaluation methods like LQAS in ensuring the quality of RHIS data [62, 65]. In our study, although LQAS performance was uniform across health facilities, differences in RCA practice demonstrated its importance in improving the data quality across IMRs in institutional birth. The RCA is effective because it allows healthcare organizations to engage in in-depth discussions regarding the barriers to data quality [69]. Hence, the result of our study emphasizes the importance of establishing clear RCA implementation guidelines and ongoing stakeholder follow-up for maintaining its implementation further to enhance the institutional birth and overall RHIS data quality. In practice, healthcare facilities and providers need to recognize RCA’s value in improving data quality. Emphasizing RCA sessions in the existing HMIS training programs could help healthcare providers value the benefits of RCA in enhancing data quality.
To conclude, unlike prior research, which focused on evaluating data quality at the institutional level, our study assessed data quality within IMRs of institutional births and the associated factors. However, it is essential to note a potential limitation: the inherent subjectivity and potential for interviewer bias when data collectors judge completeness and consistency. To minimize interviewer bias, the purpose of the study was emphasized during the data collection training.
Conclusions
While consistency fell far short of the standard, most of IMRs exhibited good completeness. The proportions of completeness and consistency varied across the three types of IMRs examined in this study. Factors identified to affect the completeness and consistency of data within IMRs of institutional birth include the presence of trained personnel responsible for data quality, the extent of supportive supervision from higher-level officials, and the practice of RCA within health facilities to address data quality gaps. In light of these findings, it is essential to integrate IMRs into existing RHIS data quality assessment initiatives, strengthen the implementation of RCA practices at the health facility level, and continue offering training and support to healthcare facilities. These essential measures for enhancing the quality of institutional birth data and overall data within the RHIS are particularly crucial in resource-limited settings like Ethiopia.
Availability of data and materials
The corresponding author can provide data upon reasonable request.
Abbreviations
- ANC:
-
Antenatal care
- COR:
-
Crude odds ratio
- AOR:
-
Adjusted odds ratio
- CBMP:
-
Capacity Building and Mentorship Program
- CI:
-
Confidence interval
- FMOH:
-
Ethiopian Federal Ministry of Health
- HIT:
-
Health Information Technology
- HMIS:
-
Health Management Information System
- IIF:
-
Integrated Individual Folder
- IMR:
-
Individual Medical Record
- LQAS:
-
Lot Quality Assurance Sampling
- MCH:
-
Maternal and Child Health Department
- MRN:
-
Medical Record Number
- MRU:
-
Medical Record Unit
- PMT:
-
Performance Monitoring Team
- PNC:
-
Post Natal Care
- RCA:
-
Root Cause Analysis
- RHIS:
-
Routine Health Information System
- ROC:
-
Receiver-operating characteristics
- SS:
-
Supportive supervision
- VIF:
-
Variance Inflation Factor
- WHO:
-
World Health Organization
References
Tunçalp Ó¦, Were W, MacLennan C, Oladapo O, Gülmezoglu A, Bahl R, et al. Quality of care for pregnant women and newborns—the WHO vision. BJOG. 2015;122(8):1045.
Mony PK, Jayanna K, Varghese B, Washington M, Vinotha P, Thomas T. Adoption and completeness of documentation using a structured delivery record in secondary care, subdistrict government hospitals of Karnataka State, India. Health Serv Res Manag Epidemiol. 2016;3:2333392816647605.
AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bull World Health Organ. 2005;83:578–83.
Heywood A, Boone D. Guidelines for data management standards in routine health information systems. Measure evaluation. Geneva: USAID; 2015.
Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, Gülmezoglu AM, Temmerman M, Alkema L. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014;2(6):e323–33. https://doi.org/10.1016/S2214-109X(14)70227-X.
WHO. Maternal mortality 2019. Available from: www.who.int/news-room/fact-sheets/detail/maternal-mortality. Cited 11/17/2022.
World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016. [cited 2022 8 November 2022]. Monography in English | MMyP | ID: per-3087]. Available from: https://pesquisa.bvsalud.org/portal/resource/pt/per-3087?lang=en.
Agyeman CM, Binfoh KA, Lakhawat PS. Assessing the dimensions of hospital records (medical records) in delivering quality of service to patients. PharmaTutor. 2018;6(8):1–8. https://doi.org/10.29161/PT.v6.i8.2018.1.
Wong REX, Bradley EH. Developing patient registration and medical records management system in Ethiopia. Int J Qual Health Care. 2009;21(4):253–8.
Veenstra M, Skinner MS, Sogstad MKR. A nation-wide cross-sectional study of variations in homecare nurses’ assessments of informational continuity - the importance of horizontal collaboration and municipal context. BMC Health Serv Res. 2020;20(1):464. https://doi.org/10.1186/s12913-020-05313-3.
Kerber KJ, de Graft-Johnson JE, Bhutta ZA, Okong P, Starrs A, Lawn JE. Continuum of care for maternal, newborn, and child health: from slogan to service delivery. Lancet. 2007;370(9595):1358–69. https://doi.org/10.1016/S0140-6736(07)61578-5.
Emiru AA, Alene GD, Debelew GT. Women’s retention on the continuum of maternal care pathway in west Gojjam Zone, Ethiopia: multilevel analysis. BMC Pregnancy Childbirth. 2020;20:258.
Bali A, Bali D, Iyer N, Iyer M. Management of medical records: facts and figures for surgeons. J Oral Maxillofac Surg. 2011;10(3):199–202. https://doi.org/10.1007/s12663-011-0219-8.
Marutha N, Ngoepe M. The role of medical records in the provision of public healthcare services in the Limpopo province of South Africa. South Afr J Inform Manage. 2017;19(1):1–8.
Moges H-T, Dejaeger K, Lemahieu W, Baesens B. A multidimensional analysis of data quality for credit risk management: new insights and challenges. Inf Manag. 2013;50(1):43–58. https://doi.org/10.1016/j.im.2012.10.001.
Mashoufi M, Ayatollahi H, Khorasani-Zavareh D. A review of data quality assessment in emergency medical services. Open Med Inform J. 2018;12(1):19–32. https://doi.org/10.2174/1874431101812010019.
Smerek MM. Assessing Data Quality for Healthcare Systems Data Used in Clinical Research (Version 1.0): The NIH Health Care Systems Research Collaboratory; 2015. [cited 2023 10/20/2023]. Available from: https://www.researchgate.net/profile/Meredith-Zozus-2/publication/283267713_Data_Quality_Assessment_Recommendations_for_Secondary_ise_of_EHR_Data/links/562f9d3908aeb1709b6000af/Data-Quality-Assessment-Recommendations-for-Secondary-ise-of-EHR-Data.pdf.
Gonete TZ, Yazachew L, Endehabtu BF. Improving data quality and information utilization at Metema Primary Hospital, Amhara national regional state, Northwest Ethiopia 2018: capstone project. Health Inf J. 2021;27(3):14604582211043160.
Tadesse K, Gebeyoh E, Tadesse G. Assessment of health management information system implementation in Ayder referral hospital, Mekelle, Ethiopia. Int J Intell Inf Syst. 2014;3(4):34.
Achampong EK, Godwin Adzakpah G, Boadu RO. The Quality of Newborn Data: Assessment of Data Management and Reporting System. Int J Public Health Sci. 2018. https://doi.org/10.11591/ijphs.v7i3.14386.
Al Hilfi RA, Mahmoud RA, Al-Hamadi N, Majeed A, Saihoud SA. Assessment of the documentation completeness level of the medical records in Basrah General Hospital. Med J Basrah Univ. 2018;36(2):50–9.
Hadyan MF, Nadjib M. Completeness of inpatient medical record files in obstetric and gynecology cases during pandemic period. J Aisyah: J Ilmu Kesehatan. 2022;7(S1):191–200.
Pirkle CM, Dumont A, Zunzunegui M-V. Medical recordkeeping, essential but overlooked aspect of quality of care in resource-limited settings. Int J Qual Health Care. 2012;24(6):564–7. https://doi.org/10.1093/intqhc/mzs034.
Nshimyiryo A, Kirk CM, Sauer SM, Ntawuyirusha E, Muhire A, Sayinzoga F, Nshimyiryo A, Kirk CM, Sauer SM, Ntawuyirusha E, Muhire A, Sayinzoga F, Hedt-Gauthier B. Health management information system (HMIS) data verification: a case study in four districts in Rwanda. PLoS One. 2020;15(7): e0235823. https://doi.org/10.1371/journal.pone.0235823.
Endriyas M, Alano A, Mekonnen E, Ayele S, Kelaye T, Shiferaw M, Endriyas M, Alano A, Mekonnen E, Ayele S, Kelaye T, Shiferaw M, Misganaw T, Samuel T, Hailemariam T, Hailu S. Understanding performance data: health management information system data accuracy in Southern Nations Nationalities and People’s Region, Ethiopia. BMC Health Serv Res. 2019;19(1):175. https://doi.org/10.1186/s12913-019-3991-7.
Arsenault C, Yakob B, Kassa M, Dinsa G, Verguet S. Using health management information system data: case study and verification of institutional deliveries in Ethiopia. BMJ Glob Health. 2021;6(8):e006216.
Kebede M, Adeba E, Chego M. Evaluation of quality and use of health management information system in primary health care units of east wollega zone, Oromia regional state, Ethiopia. BMC Med Inform Decis Mak. 2020;20(1):107. https://doi.org/10.1186/s12911-020-01148-4.
Ouedraogo M, Kurji J, Abebe L, Labonté R, Morankar S, Bedru KH, Ouedraogo M, Kurji J, Abebe L, Labonté R, Morankar S, Bedru KH, Bulcha G, Abera M, Potter BK, Roy-Gagnon M-H, Kulkarni MA. A quality assessment of Health Management Information System (HMIS) data for maternal and child health in Jimma Zone, Ethiopia. PLoS One. 2019;14(3): e0213600. https://doi.org/10.1371/journal.pone.0213600.
Fikru ND, Dereje BD. Evaluation of HMIS data quality and information use improvement for local action-oriented performance monitoring in Beghi District in West Wollega, Oromia, Ethiopia. J Health Med Nurs. 2018;50:2422–8419.
Driving Distance Calculator and Driving Directions Ethiopia [cited 2023 8/19/2023]. Available from: https://distancecalculator.globefeed.com/Ethiopia_Distance_Result.asp?vr=sehest&fromlat=9.0333333&fromlng=38.7&tolat=13.36505&tolng=37.01498&fromplace=Addis%20Ababa,%20Ethiopia%20FDRE%20ET&toplace=Sanja,%20Ethiopia.
Ethiopian Central Statistical Agency (CSA). opulation Size by Sex, Region, Zone and Wereda: July 2021. Addis Ababa: CSA; 2021.
Kesetebirhan A. National guideline for family planning services in Ethiopia. 2011:20–3. [cited 2023 10/20/2023]. Available from: https://pdf4pro.com/view/national-family-planning-guideline-phe-ethiopia-1876ed.html.
Alemu MB, Atnafu A, Gebremedhin T, Endehabtu BF, Asressie M, Tilahun B. Outcome evaluation of capacity building and mentorship partnership (CBMP) program on data quality in the public health facilities of Amhara National Regional State, Ethiopia: a quasi-experimental evaluation. BMC Health Serv Res. 2021;21(1):1–13.
Capacity Building and Mentorship Program (CBMP). https://ehealthlab.org/projects/cbmp/.
Alaro T, Sisay S, Samuel S. Implementation level of health management information system program in governmental hospitals of Ethiopia. Int J Intell Inf Syst. 2019;8(2):52.
Federal Mistry of Health Policy Plan Directorate. HMIS Indicator Reference Guide 2017. Available from: https://www.coursehero.com/file/111469935/Indicator-Reference-Guide-Aug-21-2017pdf/. Cited 11/17/2022.
JSI. Health Sector Transformation Plan-II (HSTP-II). 2021. Available from: https://ethiopiadup.jsi.com/resource/health-sector-transformation-plan-ii-hstp-ii/. Cited 2023 9/30/2023.
N Health Metrics, WHO. Framework and standards for country health information systems. 2nd ed. Geneva: World Health Organization; 2008.
Federal Mistry of Health, Directorate PP. HMIS data recording and reporting procedures guideline. Addis Ababa; 2017. Available from: http://www.aau.edu.et/chs/?wpdmact=process&did=MzI3LmhvdGxpbms=. Cited 2022 11/17/2022.
Feder SL. DataQuality in Electronic Health Records Research: Quality Domains and AssessmentMethods. West J Nurs Res. 2017;40(5):753–66.
Kahn MG, Callahan TJ, Barnard J, Bauck AE, Brown J, Davidson BN, Estiri H, Goerg C, Holve E, Johnson SG, Liaw ST, Hamilton-Lopez M, Meeker D, Ong TC, Ryan P, Shang N, Weiskopf NG, Weng C, Zozus MN, Schilling L. A Harmonized Data Quality Assessment Terminology and Framework for the Secondary Use of Electronic Health Record Data. EGEMS (Wash DC). 2016;4(1):1244. https://doi.org/10.13063/2327-9214.1244.
Measure Evaluation. Performance of Routine Information System Management (PRISM) Toolkit: PRISM tools: MEASURE Evaluation, University of North Carolina USA; 2019. [cited 2023 10/20/203]. Available from: https://www.measureevaluation.org/resources/publications/tl-18-12/index.html.
Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening andevaluating routine health information systems. Health Policy Plan. 2009;24(3):217–28.
Federal Mistry of Health. Policy Plan Directorate. Health data quality training module participant manual Addis Ababa. 2018. [cited 2023 10/20/2023]. Available from: http://www.aau.edu.et/chs/?wpdmact=process&did=MzMwLmhvdGxpbms=.
World Health Organization. Data quality review: module 3: data verification and system assessment: World Health Organization; 2017. [cited 2023 10/20/2023]. Available from: https://www.who.int/publications/i/item/9789240049123.
Goldstein H. Multilevel statistical models: Wiley; 2011. https://onlinelibrary.wiley.com/doi/book/10.1002/9780470973394.
Hox J, Moerbeek M, van de Schoot R. Multilevel Analysis: Techniques and Applications, Third Edition (3rd ed.). Routledge; 2017. https://doi.org/10.4324/9781315650982.
Archer KJ, Lemeshow. Goodness-of-fit test for a logistic regression model fitted using survey sample data. Stata J. 2006;6(1):97–105.
Bayman EO, Dexter F. Multicollinearity in Logistic Regression Models. Anesth Analg. 2021;133(2):362–5. https://doi.org/10.1213/ANE.0000000000005593.
Royston P, Altman DG. Visualizing and assessing discrimination in the logistic regression model. StatMed. 2010;29(24):2508–20.
Lodge W, Menon G, Kuchukhidze S, Jumbam DT, Maongezi S, Alidina S, et al. Assessing completenessof patient medical records of surgical and obstetric patients in NorthernTanzania. Glob Health Action. 2020;13(1):1765526.
Endriyas M, Kawza A, Alano A, Lemango F. Quality of medical records in public health facilities: Acase of Southern Ethiopia, resource limited setting. Health Inform J. 2022;28(3):14604582221112852.
Kahn MG, Raebel MA, Glanz JM, Riedlinger K, Steiner JF. A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. Med Care. 2012;50 Suppl(0):S21–9. https://doi.org/10.1097/MLR.0b013e318257dd67.
Sariyar M, Borg A, Heidinger O, Pommerening K. A practical framework for data management processesand their evaluation in population-based medical registries. Inform Health Soc care. 2013;38(2):104–19.
Garavand A, Rabiei R, Emami H, Pishgahi M, Vahidi-Asl M. The attributes of hospital-based coronaryartery diseases registries with a focus on key registry processes: A systematicreview. Health Inf Manag. 2022;51(2):63–78.
Upadhyay S, Hu HF. AQualitative Analysis of the Impact of Electronic Health Records (EHR) onHealthcare Quality and Safety: Clinicians’ Lived Experiences. Health ServInsights. 2022;15:11786329211070722.
Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment:enabling reuse for clinical research. J Am Med Inform Assoc. 2013;20(1):144–51.
Lee K, Weiskopf N, Pathak J. A Framework for Data Quality Assessment in Clinical ResearchDatasets. AMIA Annu Symp Proc. 2017;2017:1080–9.
Bian J, Lyu T, Loiacono A, Viramontes TM, Lipori G, Guo Y, et al. Assessing the practice ofdata quality evaluation in a national clinical data research network through asystematic scoping review in the era of real-world data. J Am Med Inform Assoc. 2020;27(12):1999–2010.
Barnawi RA, Ghurab AM, Balubaid HK, Alfaer SS, Hanbazazah KA, Bukhari MF, et al. Assessment of junior doctors’ admission notes: do they follow what they learn? Int J Med Educ. 2017;8:79.
Teklegiorgis K, Tadesse K, Terefe W, Mirutse G. Level of data quality from Health ManagementInformation Systems in a resources limited setting and its associated factors, eastern Ethiopia. South African Journal of Information Management. 2016;18(1):1–8.
Solomon M, Addise M, Tassew B, Balcha B, Abebe A. Data quality assessment and associated factors inthe health management information system among health centers of SouthernEthiopia. PLoS One. 2021;16(10).
Shiferaw AM, Zegeye DT, Assefa S, Yenit MK. Routine health information system utilization and factors associated thereof among health workers at government health institutions in East Gojjam Zone, Northwest Ethiopia. BMC Med Inform Decis Mak. 2017;17(1):116.
Fisseha G, Berhane Y, Worku A. Quality of intrapartum and newborn care in Tigray, Northern Ethiopia. BMC Pregnancy Childbirth. 2019;19(1):37.
Getachew N, Erkalo B, Garedew MG. Data quality and associated factors in the health managementinformation system at health centers in Shashogo district, Hadiya zone, southern Ethiopia, 2021. BMC Med Inform Decis Mak. 2022;22(1):154.
Pratama TWY, Tamtomo D, Sulaeman ES. Factors associated with the completeness of inpatient medical record filling in Dr. R Sosodoro Djatikoesoemo, Bojonegoro, East Java. J Health Policy Manag. 2018;3(1):1–10.
Chanyalew MA, Yitayal M, Atnafu A, Tilahun B. Routine health information system utilization for evidence-based decision making in Amhara national regional state, northwest Ethiopia: a multi-level analysis. BMC Med Inform Decis Mak. 2021;21(1):28.
Nguefack-Tsague G, Tamfon BB, Ngnie-Teta I, Ngoufack MN, Keugoung B, Bataliack SM, et al. Factorsassociated with the performance of routine health information system inYaoundé-Cameroon: A cross-sectional survey. BMC Medical Informatics andDecision Making. 2020;20(1):1–8.
Jones RW, Despotou G. Root Cause Analysis and Health Informatics. Stud Health Technol Inform. 2016;226:131–4.
Acknowledgements
We would like to express our gratitude to the supervisors, Doris Duke Charitable Foundation, data collectors; and health office departments of the central Gondar zone, Wegera, and Tach-armachiho districts.
Funding
This work would not be possible without the financial support of Doris Duke Charitable Foundation under grant number 2017187. The mission of the Doris Duke Charitable Foundation is to improve the quality of people’s lives through grants supporting the performing arts, environmental conservation, medical research, and child well-being, and through preservation of the cultural and environmental legacy of Doris Duke’s properties.
Author information
Authors and Affiliations
Contributions
B.K have conceived and designed the study, performed the study, analyzed and interpreted the data, and wrote the manuscript. L.D, A.A, S.A, and BT have performed the study, analyzed and interpreted the data, and wrote the manuscript. All authors reviewed and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Ethical clearance was granted by the Institutional Ethical Review Board of the University of Gondar (R.N.O.: V/P/RCS/05/861–2021). A letter of support was also obtained from the central Gondar zone Health Office Department. The mother’s name and other identity details were used solely to facilitate data collection and were deidentified throughout the analysis. As this study involved medical records instead of human subjects, informed consent could not be obtained from participants. An Institutional Ethical Review Board of the University of Gondar waived informed consent requirements. Besides, all methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Supplementary 1.
A Checklist for reviewing Individual medical records
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Taye, B.K., Gezie, L.D., Atnafu, A. et al. Data completeness and consistency in individual medical records of institutional births: retrospective crossectional study from Northwest Ethiopia, 2022. BMC Health Serv Res 23, 1189 (2023). https://doi.org/10.1186/s12913-023-10127-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-023-10127-0