Skip to main content

Advertisement

National quality register of congenital heart diseases – Can we trust the data?

Abstract

Background

The SWEDish registry of CONgenital heart disease is a Swedish national quality register for collecting data on pediatric and adult (GUCH) patients with congenital heart diseases that aims to improve medical practice and research. The aim of this study was to validate data in the register using data in medical records.

Methods

This cross-sectional observational study compared specific variables from SWEDCON with data retrieved from medical records for 182 pediatric and 186 adult patients who were randomly selected from four different hospitals.

Results

The absolute concordance for date of visit, diagnosis, information on surgery and catheter intervention was 71–98% between SWEDCON and medical journals. The specificity for cardiac examinations and specific medical therapy was 71–100%. The concordance for information for transition from pediatric care to GUCH or finishing regular check-ups was 92%.

Conclusion

The overall concordance between data in SWEDCON-pediatric as well as SWEDCON-GUCH with data in medical records was good, and data from SWEDCON is reliable to use for medical improvements and for research purposes.

Background

Every year in Sweden, 800–1000 children are born with a congenital heart defect. Survival rates have improved and the population of adults with congenital heart defects now exceeds.

40,000 in Sweden [1, 2]. Government-administered registers cover a high proportion of the population in Sweden, but often lack detailed information on disease-specific data, patient-reported outcome measures such as quality of life (QoL) or aspects of management. The SWEDish registry of CONgenital heart disease [3] is a Swedish national quality register for collecting data on patients with congenital heart diseases. The adult register was created in the early 1990s and, by 2009, a pediatric and a surgical section had been merged with the register, with data also being imported from other hospital-based registers. The register now has four parts: fetal heart diagnosis, pediatric cardiology, Grown Up Congenital Heart disease (GUCH) and congenital heart surgery. These have a common basis, with information on each patient, including personal data, diagnosis, operations and catheter interventions. Information on mortality is either derived from user input – the basis for our analysis – or from monthly updates to official statistics, which are used in analytical reports from the register. The SWEDCON register is longitudinal, making it possible to follow patients with congenital heart disease throughout their entire lives, as data from the different parts of the register are combined.

Nationwide, 31 pediatric units register individuals less than 19 years old in SWEDCON-pediatric. Patients older than 16 years are registered in SWEDCON/GUCH if they have had at least one evaluation at one of the seven GUCH centers or the 15 (out of 18) county hospitals that are affiliated to SWEDCON-GUCH. SWEDCON has an overall coverage rate of 84% of all hospitals in the country [4]. The aim of the register is to improve medical practice, both in the long and the short-term, and to be used for research. An increasing number of studies are based on SWEDCON, although a nationwide validation has not yet been done.

The aim of this validation study was to assess data registered in SWEDCON-pediatric and SWEDCON-GUCH against the data registered in the patients’ medical records.

Methods

Study design and study sample

This cross-sectional observational study, performed in the second half of 2016, compared specific variables from SWEDCON with data in medical records. Two larger centers and two county hospitals in different parts of Sweden were included in the study. The hospitals were representative of all hospitals treating patients with congenital heart defects.

Over 200 pediatric and 200 GUCH patients from these hospitals were randomly selected by the register-holders. Inclusion was restricted to certain main cardiac diagnoses in order to improve the study’s specificity (Table 1 and 2) and to patients born in 2015 or earlier.

Table 1 Demographics
Table 2 Retrieval of information in SWEDCON in medical journals
Table 3 Concordance between SWEDCON and medical records. Visits and diagnosis
Table 4 Information on examinations and medical therapy
Table 5 Information on medical therapy

Data was manually retrieved by one of the authors (AB) from medical records and compared with data registered in SWEDCON in a standardized manner (Table 1). AB, a medical student, was specially trained in the nomenclature of congenital cardiology and supervised by a pediatric cardiologist (EN).

Information of analysis of specific variables

Outpatient visits

The last two registered outpatient visits at a GUCH or pediatric clinic in 2009 or after were recorded. Concordance with the date of visit was assessed as true within 7 days between the date of visit and date of registration. Examinations that are seldom performed during an outpatient clinical visit (such as angiography or coronary angiography, heart catheterization, isotope, chest radiograph, MRI, electrophysiology, CT, fetal echocardiography and 24-h blood pressure), were considered concordant with the date of an outpatient clinical visit if the examination took place within 3 months of the outpatient clinical visit, as this is a normal interval from referral to this type of examination.

Visits to a sonographer were registered as a doctor’s visit in the protocol when echocardiography was evaluated by a pediatric cardiologist. When a consultant from a GUCH center examined a patient at a smaller hospital, the visit was recorded as having been performed at the smaller hospital if this hospital was included in the study. If the smaller hospital was not included in the study, we had no access to medical records and the patient was therefore excluded from analysis (Fig. 1). Further, special analysis was preformed to check whether the last visit in SWEDCON was concordant with the visit before last one in the medical record, and vice versa.

Fig. 1
figure1

Retrieval of study population

Only major cardiac centers register stays in hospital, so inpatient stays were therefore not recorded in this study.

The transition of care from pediatric to GUCH, as well as finishing regular check-ups, is marked specifically in SWEDCON, and this was measured as concordant when there was a transition stated in the medical record. Finishing regular check-ups may be marked in SWEDCON when no more visits are needed, such as in cases that are spontaneously closed ASD.

Diagnosis

The main cardiac diagnoses in SWEDCON were compared to main cardiac diagnoses in medical records. Cardiac diagnoses in SWEDCON are registered according to the European pediatric cardiac coding [5] and the WHO ICD-10 codes [6]. Similar diagnoses within the same ICD 10-group were recorded as concordance of diagnosis. Classification of surgical and catheter inventions were recorded using the “Swedish classification of care measures” (KVÅ) [7]. In the absence of KVÅ classification in the medical record, the full name of the surgical or catheter intervention was translated to the KVÅ classification.

Statistical analysis

Data retrieved from SWEDCON was compared to data registered in medical records. The number and proportion of data corresponding to each data source were calculated. The degree of agreement was estimated using the percentage of agreement and Cohen’s kappa when appropriate. Sensitivity and specificity were analyzed using data from the medical record to be the true value, and a confidence interval of 95% was used.

Results

Study population

In total, 210 patients were randomly retrieved by Uppsala Clinical Research Centre (UCR), the register’s technical platform, from SWEDCON-pediatric and 214 patients from SWEDCON-GUCH. From these, 28 pediatric patients and 28 GUCH patients were excluded from the study because either no outpatient visits had been recorded in SWEDCON or the medical records were not available (Fig. 1).

Concordance of information between SWEDCON and medical records

The pediatric study population consisted of 182 patients (Table 1) and most patients had more than one visit (85%). The overall concordance between SWEDCON-pediatric and medical records was good. The absolute concordance for date of visit was 71%, for cardiac diagnosis 74% and for cardiac therapy 98%. The concordance for transition from pediatric care to GUCH or finishing regular check-ups was 92%, with a Cohen’s kappa of 0.89 (Table 3).

The concordance between SWEDCON and medical records for performed examinations related to the last medical outpatient visit was 87–100%, with a specificity of 100% for most data (Table 4).

The GUCH study population consisted of 186 patients (Table 1). The majority of patients had more than one visit (80%). Date of visit was concordant to 85%. The degree of concordance between SWEDCON and medical records on diagnosis was 79–80% (Table 3). The concordance between SWEDCON and medical records for examinations was between 72 and 99% (Table 4).

Medical treatment was grouped differently in SWEDCON-pediatric and SWEDCON-GUCH. The concordance between data regarding different types of medical treatment in SWEDCON and medical records was 86–100% with a specificity of 86–100% and a sensitivity of 50–100% (Table 5). Medical cardiac therapy was only analyzed for patients on medical therapy.

There were no deaths in the GUCH population. Two patients in the pediatric study population were deceased according to medical records, but only one of these was registered as deceased in SWEDCON.

Discussion

Overall, the concordance for data in SWEDCON registry compared to data in medical records was good. Specificity ranged from 71 to 100%, which implies that information in the SWEDCON register is accurate for the majority of the data. Sensitivity ranges from 33 to 100%, where almost half the variables (16 out of 34 variables) have a sensitivity above 80%.

Quality register data are used for health quality improvements and research. Validation as well as presentation have been published and good inter-reliability has been found for many Swedish quality registers [8,9,10]. The overall concordance of data between SWEDCON and medical records, along with a coverage rate for SWEDCON of 84%, supports the idea of using data from SWEDCON for health improvements and research.

Participation in SWEDCON is voluntary, for both patients and medical staff. The overall experience from the research group is that few patients and no participating medical staff have refused to register in SWEDCON. Data is reported in SWEDCON by physicians, registered nurses or specially trained secretaries at the time of the patient visit, or shortly thereafter. Older data have been imported to SWEDCON from local registers in Lund and Stockholm at the start of the pediatric part of SWEDCON. Excellent concordance between information in medical records and SWEDCON was seen for examinations and medical treatment, while concordance was less robust on specific dates of visits, exact diagnosis, surgical and catheter interventions. The reason for this is not known, we speculate that as the manually recording of diagnosis (main and secondary diagnosis) is made differently in medical records and SWEDCON, the main diagnosis appears be non-concordance when comparing, while it is the ranking of diagnoses that differs. Further, our study did not include old data, as the inclusion criteria were visits in 2009 or after that were registered in SWEDCON, which may have influenced the inferior results in our study for information on diagnosis and interventions (surgery and catheter) compared to data in medical records. A small validity control of 132 patients in SWEDCON-GUCH found a concordance of 95% for main diagnosis, surgical KVÅ code and date of last surgery [3]. That study did not have limitations on the date of registration, birth year and hospital, and thus we believe the concordance between SWEDCON and medical records may be better than we were able to prove in our study.

ICD-10 codes and KVÅ codes are used in medical records; as European pediatric cardiac coding (EPCC) is used to register data in SWEDCON, the EPCC codes had to be manually translated to diagnostic codes in the ICD-10 and KVÅ systems for the comparison. This may have introduced a misclassification in our study. However, we used words which described the surgery and intervention, not only the code, in our registration and so we believe the risk of misclassification was reduced. Agreement on diagnostic tool and awareness of the inconsistencies between the EPCC and the ICD-10 and KVÅ codes is crucial when studying SWEDCON data and comparing it with medical records or other national registries [11, 12].

The four parts of SWEDCON make it possible to follow a patient throughout their entire life. Follow-up studies have been performed on adults with aortic valve, coarctation and Mustard/Senning correction, and research has been performed on physical activity and muscle function in adults with congenital heart disease, as well as closure of atrial septal defect by device in the elderly and studies on incidence of endocarditis [13,14,15,16,17]. The SWEDCON registry has been the basis for studies on the transition process from pediatric cardiology to GUCH and the assessment of QoL in children with heart disease, as well as the risk of pulmonary hypertension in children and young adults who were born prematurely [3, 18]. Further research using SWEDCON, and by linkage to governmental and other disease specific quality registers, may evaluate preoperative risk factors for predicting intra- and post- operative adverse event and outcomes. Examples are studies of atrial septal defect (ASD) closure in small children as well as in elderly [17, 19]. Thus, the valid data retrieved from SWEDCON is well suitable to be used in research studies.

The links to government-administered national registries is one of the main strengths of the Swedish quality registers, including SWEDCON [20]. Low concordance between register data and medical journals was found in a study from Denmark, which was explained by diagnoses not being altered in the register after a patient had been referred to a specialized unit that changed the diagnosis [21]. In SWEDCON, mortality is either derived from user input – the basis for our analysis – or from monthly updates to official statistics, which are used in analytical reports from the register. The missing information on one death in our study may have been due to this monthly delay.

This study includes a large range of variables in pediatric and GUCH patients with five different cardiac diagnoses, which allows a sufficient sample size for testing the register. Differences in registration procedures were accounted for by including a variation in the size of hospital. All data in SWEDCON was validated according to medical records based on strict and predefined criteria in this study and performed by one observer (AB). This strengthens the study. However, this was a sample study at four hospitals affiliated to SWEDCON, so if a patient had changed hospitals, to a hospital not included in the study, we were unable to confirm their information in SWEDCON against the medical records of the new hospital. A few small hospitals in Sweden have not yet been affiliated to SWEDCON, which may influence advice on the best clinical practice based on research from the register. It is therefore important that a majority of centers, preferably all, that monitor children and adults with congenital heart disease are affiliated to SWEDCON.

Complete validation between data from all medical journals and SWEDCON would be difficult, time-consuming and expensive. In order to further validate SWEDCON, the research group plans to study the concordance between all patients in SWEDCON and the Swedish National Patient Register with regard to diagnosis and date of visit.

Conclusion

This validity study of SWEDCON found substantial agreement between information in the register and medical records. Data in SWEDCON can be considered reliable and can be used in research and health care improvements. However, improvements can be made to the register, especially concerning concordance in registration, through the use of similar diagnostic codes for surgeries and interventions in both medical records and SWEDCON.

Abbreviations

EPCC:

European pediatric cardiac coding

GUCH:

Grown Up Congenital Heart disease

KVÅ:

“Swedish classification of care measures”

QoL:

Quality of life

SWEDCON:

SWEDish registry of CONgenital heart disease

References

  1. 1.

    Marelli AJ, Ionescu-Ittu R, Mackie AS, Guo L, Dendukuri N, Kaouache M. Lifetime prevalence of congenital heart disease in the general population from 2000 to 2010. Circulation. 2014;130(9):749–56.

  2. 2.

    Marelli AJ, Mackie AS, Ionescu-Ittu R, Rahme E, Pilote L. Congenital heart disease in the general population: changing prevalence and age distribution. Circulation. 2007;115(2):163–72.

  3. 3.

    SWEDCON. SWEDCON annual report. http://www.ucr.uu.se/swedcon/arsrapporter; 2015.

  4. 4.

    Analysis of quality register cover rate. Nationella kvalitetsregisters täckningsgrad. http://www.vardanalys.se The Swedish Agency for Health and Care Services Analysis.(in swedish). Myndigheten för vårdanalys; 2014.

  5. 5.

    Coding Committee of the Association for European Paediatric C. The European Paediatric Cardiac Code: the first revision. Cardiol Young. 2002;12 Suppl 2:1–211.

  6. 6.

    World Health Organization International Statistical Classifications of Diseases and Related Health Problems 10th Revision. http://www.who.int/classifications/icd/en/.

  7. 7.

    National board of Health and Wellfare. Classification of operations and interventions. Socialstyrelsen. Klassifikation av vårdåtgärder.(in swedish). http://www.socialstyrelsen.se/klassificeringochkoder.

  8. 8.

    Hagman E, Arani PI, Fischer M, Danielsson P, Marcinkiewicz K, Petriczko E, et al. Blood sugar levels are higher in obese young children in Sweden than in Poland. Acta Paediatr. 2014;103(11):1174–8.

  9. 9.

    Rodby-Bousquet E, Agustsson A, Jonsdottir G, Czuba T, Johansson AC, Hagglund G. Interrater reliability and construct validity of the posture and postural ability scale in adults with cerebral palsy in supine, prone, sitting and standing positions. Clin Rehabil. 2014;28(1):82–90.

  10. 10.

    Friling E, Lundstrom M, Stenevi U, Montan P. Six-year incidence of endophthalmitis after cataract surgery: Swedish national study. J Cataract Refract Surg. 2013;39(1):15–21.

  11. 11.

    Baumgartner H. What news in the 2010 European Society of Cardiology (ESC) guidelines for the management of grown-up congenital heart disease? J Cardiovasc Med (Hagerstown). 2013;14(2):100–3.

  12. 12.

    Baumgartner H, Bonhoeffer P, De Groot NM, de Haan F, Deanfield JE, Galie N, et al. ESC guidelines for the management of grown-up congenital heart disease (new version 2010). Eur Heart J. 2010;31(23):2915–57.

  13. 13.

    Berglund E, Johansson B, Dellborg M, Sorensson P, Christersson C, Nielsen NE, et al. High incidence of infective endocarditis in adults with congenital ventricular septal defect. Heart. 2016;102:1835–1839.

  14. 14.

    Sandberg C, Engstrom KG, Dellborg M, Thilen U, Wadell K, Johansson B. The level of physical exercise is associated with self-reported health status (EQ-5D) in adults with congenital heart disease. Eur J Prev Cardiol. 2015;22(2):240–8.

  15. 15.

    Sandberg C, Rinnstrom D, Dellborg M, Thilen U, Sorensson P, Nielsen NE, et al. Height, weight and body mass index in adults with congenital heart disease. Int J Cardiol. 2015;187:219–26.

  16. 16.

    Sandberg C, Thilen U, Wadell K, Johansson B. Adults with complex congenital heart disease have impaired skeletal muscle function and reduced confidence in performing exercise training. Eur J Prev Cardiol. 2015;22(12):1523–30.

  17. 17.

    Thilen M, Christersson C, Dellborg M, Mattsson E, Trzebiatowska-Krzynska A, Thilen U. Catheter closure of atrial septal defect in the elderly (>/=65years). A worthwhile procedure. Int J Cardiol. 2016;218:25–30.

  18. 18.

    Naumburg E, Soderstrom L, Huber D, Axelsson I. Risk factors for pulmonary arterial hypertension in children and young adults. Pediatr Pulmonol. 201752;636–641. doi:10.1002/ppul.23633.

  19. 19.

    Tanghoj G, Odermarsky M, Naumburg E, Liuba P. Early complications after percutaneous closure of atrial septal defect in infants with procedural weight less than 15 kg. Pediatr Cardiol. 2017;38(2):255–263

  20. 20.

    Emilsson L, Lindahl B, Koster M, Lambe M, Ludvigsson JF. Review of 103 Swedish healthcare quality registries. J Intern Med. 2015;277(1):94–136.

  21. 21.

    Lasota AN, Overvad K, Eriksen HH, Tjonneland A, Schmidt EB, Gronholdt MM. Validity of peripheral arterial disease diagnoses in the Danish National Patient Registry. Eur J Vasc Endovasc Surg. 2017;53:679–85.

Download references

Acknowledgements

We thank the SWEDCON register and its steering committee for sharing data and the Uppsala Clinical Research Centre (UCR) for help with the randomizing and selection of data. We also thank all the doctors and nurses who work with patients with congenital heart defects in Sweden, who contribute data and make this register possible.

Funding

This paper has received no funding.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Author information

EN had the primary responsibility for study, protocol development, patient enrollment, outcome assessment, preliminary data analysis and writing the manuscript. GB and UT participated in the analytical framework for the study and contributed to the writing of the manuscript. AB participated in the analytical framework of the study, was primarily responsible for collecting data from medical records and the registry, was primarily responsible for data analyses and contributed to writing the manuscript.

All authors read and approved the final manuscript.

Correspondence to Estelle Naumburg.

Ethics declarations

Authors’ information

At the time of the study, AB was a medical student at the Department of Clinical Science, Pediatrics, Umeå University, Umeå, Sweden.

GB, PhD, associate professor and senior consultant in pediatrics and pediatric cardiology at the Department of Pediatric Cardiology, University Hospital, Lund, Sweden.

UT, PhD, associate professor and senior consultant in cardiology and GUCH at the Department of Cardiology, University Hospital, Lund, Sweden.

EN, PhD, senior lecturer and a senior consultant in pediatrics and pediatric cardiology at Östersund County Hospital and the Department of Clinical Science, Pediatrics, Umeå University, Umeå, Sweden.

Ethics approval and consent to participate

The study received ethical approval from The Regional Ethical Board at Umeå University, EPN Dnr: 2016/210-31. All patients have agreed to participate in SWEDCON and in research based on the register.

Consent for publication

Not applicable.

Competing interests

UT (GUCH) and GB (pediatric) are registry-holders of SWEDCON. AB and EN declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Congenital heart defects
  • National Quality Register
  • Validation