Back to Journals » Clinical Epidemiology » Volume 10

Pheochromocytoma in Denmark during 1977–2016: validating diagnosis codes and creating a national cohort using patterns of health registrations

Authors Ebbehoj A , Jacobsen SF, Trolle C , Robaczyk MG , Rasmussen ÅK, Feldt-Rasmussen U , Thomsen RW , Poulsen PL, Stochholm K, Søndergaard E 

Received 23 January 2018

Accepted for publication 18 March 2018

Published 13 June 2018 Volume 2018:10 Pages 683—695

DOI https://doi.org/10.2147/CLEP.S163065

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 3

Editor who approved publication: Professor Henrik Sørensen



Andreas Ebbehoj,1,2 Sarah Forslund Jacobsen,3 Christian Trolle,1 Maciej Grzegorz Robaczyk,4 Åse Krogh Rasmussen,3 Ulla Feldt-Rasmussen,3 Reimar Wernich Thomsen,5 Per Løgstrup Poulsen,1 Kirstine Stochholm,1 Esben Søndergaard1

1Department of Endocrinology and Internal Medicine, Aarhus University Hospital, Aarhus, Denmark; 2Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; 3Department of Endocrinology, Rigshospitalet, Copenhagen, Denmark; 4Department of Endocrinology, Aalborg University Hospital, Aalborg, Denmark; 5Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark

Background: Pheochromocytoma and catecholamine-secreting paraganglioma (PPGL) are rare but potentially life-threatening tumors. We aimed to validate diagnosis codes for PPGL in the Danish National Patient Registry, the Danish National Pathology Registry, and the Danish Registry of Causes of Death and to create a national cohort of incident PPGL patients by linking these three registries.
Patients and methods: We obtained data from the three abovementioned registries for all individuals registered with pheochromocytoma or catecholamine hypersecretion in Denmark during 1977–2016 (average population 5.30 million). We then reviewed health records for all individuals living in the North Denmark Region and Central Denmark Region (average population 1.75 million) to validate the diagnosis of PPGL. We tested a number of algorithms for accurately identifying true cases of PPGL to maximize positive predictive values (PPVs) and completeness. The best algorithm was subsequently validated in an external sample.
Results: We identified 2626 individuals with a PPGL diagnosis code in Denmark, including 787 (30.0%) in the North Denmark Region and Central Denmark Region. In this subsample, we retrieved the health records of 771/787 (98.0%) individuals and confirmed 198 incident PPGL patients (25.3%). The PPV of PPGL diagnosis codes was 21.7% in the Danish National Patient Registry, 50.0% in the Danish Registry of Causes of Death, and 79.5% in the Danish National Pathology Registry. By combining patterns of registrations in the three registries, we could increase the PPV to 93.1% (95% confidence interval [CI]: 88.5–96.3) and completeness to 88.9% (95% CI: 83.7–92.9), thus creating a national PPGL cohort of 588 patients. PPV for the optimal algorithm was 95.3% (95% CI: 88.5–98.7) in the external validation sample.
Conclusion: Diagnosis codes for pheochromocytoma had low PPV in several individual health registries. However, with a combination of registries we were able to identify a near-complete national cohort of PPGL patients in Denmark, as a valuable source for epidemiological research.

Keywords: registry-based research, International Classification of Diseases, ICD, Systematized Nomenclature of Medicine, SNOMED, hospital register diagnoses, pathology register, cause of death register

Introduction

Pheochromocytoma and catecholamine-secreting paraganglioma (PPGL) are rare but potentially fatal catecholamine-secreting tumors.1 During recent years, improvements in imaging techniques have led to increasing number of patients being incidentally diagnosed with adrenal tumors and evaluated for catecholamine hypersecretion.2,3 Whether this has led to an increase in the incidence of PPGL, or changes in its prognosis, remains unknown. Due to the rarity of the disease, large-scale studies of incidence and clinical outcomes of PPGL are scarce and most previous studies have been limited to tertiary centers with the potential risk of referral bias and substantial loss to follow-up.47

Health care databases are a valuable source for epidemiological research in rare diseases provided diagnoses are valid. Since 1967, the unique civil registration number in the Civil Registration System has been used to register all individuals living or working in Denmark with a complete follow-up history of birth, addresses, migration, and death.8 The civil registration number enables exact linkage of all data routinely collected in national health registries in Denmark, which makes it possible to rapidly identify a complete nationwide cohort of individuals with a disease diagnosis.9,10 However, as shown in previous Danish studies on certain rare tumors10 and endocrine diseases,11,12 the validity of diagnosis codes of rare diseases may be relatively low, with positive predictive values (PPVs) of true presence of disease ranging from 30% to 55%. Applying algorithms restricting to patients hospitalized at specialized departments or undergoing certain treatment regimens may improve PPV of diagnosis codes with a limited loss of cases.1012 To our knowledge, no studies have yet validated the accuracy of PPGL registrations.

Therefore, we aimed to validate PPGL diagnosis codes and to create an algorithm that can accurately identify incident cases of PPGL in Denmark by combining data from three registries: the Danish National Patient Registry, the Danish Registry of Causes of Death, and the Danish National Pathology Registry. This would allow us to create a nationwide, population-based PPGL cohort as a source for future research on trends in the incidence, morbidity, and mortality of PPGL.

Patients and methods

Health registries, International Classification of Diseases (ICD), and Systematized Nomenclature of Medicine (SNOMED)

In Denmark, MDs report the primary cause of a contact at a Danish hospital to the Danish National Patient Registry for all in- and outpatient contacts with up to 20 secondary diagnoses.9 Likewise, for all deaths in Denmark, an MD will complete a death certificate and report one or more causes of death to the Danish Registry of Causes of Death.13 In both registries, diagnoses have been registered using the ICD 8th edition (ICD-8) until 1994, and thereafter using the 10th edition (ICD-10).9,13 For all pathological examinations performed in Denmark, the pathologist registers the diagnosis, the origin of tissue, and performed examinations in the SNOMED.14 Reporting to the three registries is mandatory in all of Denmark.

Generally, the coverage or completeness of the registries are internationally considered excellent and have not undergone any major structural changes in the last 20 years (see Table S1).9,1316

Identification of potential PPGL cases

In order to identify all individuals with potential PPGL, we obtained data from the Danish Health Authority for individuals registered with at least one diagnosis code related to pheochromocytoma or catecholamine hypersecretion in the Danish National Patient Registry, Danish National Pathology Registry, or Danish Registry of Causes of Death (Table 1).

Table 1 Eligibility criteria

Notes: Individuals were considered eligible if they had a PPGL diagnosis code as the specified type of diagnosis code in a registry, and the date of their first registered diagnosis code was between January 1, 1977, and December 31, 2017, and while they lived in Denmark. Only individuals living in the North Denmark Region and Central Denmark Region at time of first registration were included in the validation cohort. aIncluding underlying diagnosis codes. bIn the Danish National Patient Registry, SNOMED diagnosis codes can only be used as optional supplementary diagnosis codes. cDiagnosis codes in the Danish Registry of Causes of Death have a maximum length of four characters making them less detailed than in ICD-8 and ICD-10 codes in the Danish National Patient Registry.

Abbreviations: ICD-8, International Classification of Diseases 8th edition; ICD-10, International Classification of Disease 10th edition; PPGL, pheochromocytoma and catecholamine-secreting paraganglioma; SNOMED, Systematized Nomenclature of Medicine.

The primary eligibility criterion was a PPGL diagnosis code at an in- or outpatient contact (as either primary, secondary, supplementary, or referral diagnosis code), as a cause of death, or as a diagnostic conclusion of a pathological examination. We included only patients who had their first PPGL diagnosis code from January 1, 1977, to December 31, 2016, whilst living in Denmark. PPGL diagnosis codes included 255.29 (ICD8), D350A, E275, R825A (ICD10), M8700, and S29740 (SNOMED).

Validation of PPGL diagnosis codes was limited to eligible individuals living in the North Denmark Region and Central Denmark Region at the time of first PPGL diagnosis: the validation cohort. These two out of five Danish regions had an average population during the study period of 1.75 million inhabitants, corresponding to 33% of the total Danish population (average population 5.30 million, calculations based on data from public institutions).1720

Completeness of PPGL registrations

To assess if our eligibility criteria completely identified all PPGL cases, that is, if all diagnosed PPGL patients had been registered with a PPGL diagnosis code, we introduced expanded eligibility criteria. We included individuals registered with one of 31 possibly PPGL-related diagnosis codes in the Danish National Patient Registry between January 1, 1990 and February 28, 2015 (Table 2). Validation of this group was restricted to individuals registered at the Department of Endocrinology and Internal Medicine at Aarhus University Hospital, the largest endocrine center in Central Region Denmark: the expanded validation cohort.

Table 2 Expanded eligibility criteria

Notes: Individuals fulfilled expanded eligibility criteria if registered with a possibly PPGL-related diagnosis code as primary, secondary, or supplementary cause of contact in the Danish National Patient Registry, and the date of their first registered diagnosis code was between January 1, 1990, and February 28, 2015, and while they lived in Denmark. Only individuals living in the North Denmark Region and Central Denmark Region at time of first registration who also were registered with possibly PPGL-related diagnosis code at the Department of Endocrinology and Internal Medicine at Aarhus University Hospital were included in the expanded validation cohort.

Abbreviations: ICD-8, International Classification of Diseases 8th edition; ICD-10, International Classification of Disease 10th edition; PPGL, pheochromocytoma and catecholamine-secreting paraganglioma.

Further, we asked specialists in adrenal diseases from the two major endocrine centers in the validation area (Department of Endocrinology and Internal Medicine at Aarhus University Hospital and Department of Endocrinology at Aalborg University Hospital) to contribute with any additional PPGL patients who might not have been initially identified.

Thus, the final PPGL cohort in our validation area consisted of confirmed PPGL patients found in the validation cohort, the expanded validation cohort, or additionally reported by endocrine specialists (Figure 1).

Figure 1 Identification of PPGL patients in area of validation, the North Denmark Region and Central Denmark Region.

Notes: aSeven cases of doubt refuted as non-secreting paragangliomas; twenty-four refuted due to weak clinical evidence despite some inconsistencies; and six refuted due to insufficient information to confirm PPGL. bThirty-five cases of doubt confirmed as PPGL based on pathology and clinic despite no lab tests performed (diagnosed at autopsy or by pathologist post-surgery); three confirmed despite no pathological examination (patient abstained from surgery or surgery not technically possibly); and fourteen confirmed due to strong clinical evidence despite some missing data or inconsistencies. cFive refuted as non-secreting paragangliomas; six refuted as workup were insufficient to confirm PPGL. dOne patient with confirmed PPGL who did not fulfill primary or expanded eligibility criteria was reported by endocrine specialist (MGR) at Department of Endocrinology at Aalborg University Hospital.

Abbreviation: PPGL, pheochromocytoma and catecholamine-secreting paraganglioma.

Validation of PPGL diagnosis

One researcher (ALE) located and reviewed health records from hospitals for all individuals in the validation cohort. Electronic health records were reviewed, if available. Paper health records and/or records from hospitals outside the validation area were located if no electronic records existed or if necessary to definitively confirm or refute PPGL.

The researcher confirmed or refuted PPGL based on agreement among lab tests of catecholamines, vanillylmandelic acid, and metanephrines in blood or urine; imaging studies and pathological examinations; as well as the diagnostic conclusion made by treating clinician as noted in health records. Diagnostic criteria for confirming or refuting PPGL are listed in Table 3.

Table 3 PPGL diagnostic criteria for confirming or refuting PPGL

Notes: aPPGL lab tests include blood and urine measurements of catecholamines, vanillylmandelic acid, and metanephrines. A single lab test elevated fivefold or more above reference range not caused by interfering factors (interacting drugs, trauma, critical disease, etc) was considered as confirming PPGL. Three or more lab tests consistently elevated 2- to 4.9-fold were considered of moderate to high suspicion for PPGL. Varying lab tests with only one or two lab tests elevated 2- to 4.9-fold or lab tests consistently elevated less than twofold were considered of moderate to low suspicion for PPGL. One or more lab tests consistently within reference range was considered as refuting PPGL. bList of examples of cases of doubt is not exhaustive.

Abbreviation: PPGL, pheochromocytoma and catecholamine-secreting paraganglioma.

Individuals who had ambiguous results or incomplete diagnostic workup were considered cases of doubt and presented to an expert panel consisting of two specialists (PLP and ES) in endocrinology and adrenal diseases (see Table 3 for examples). Based on available information on performed tests, examinations, and imaging studies as well as medical history and presentation, the expert panel decided if PPGL was the most likely diagnosis and there was sufficient evidence to confirm it. If not, PPGL was considered refuted.

For confirmed PPGL patients, we defined the date of clinical diagnosis as the first date of a positive pathological examination, an at fivefold elevated lab test for PPGL, or the date the treating clinician confirmed PPGL according to the health records.

Data were recorded in a database designed using EpiData Manager 4.2.0.0 (EpiData Association, Odense, Denmark).

Development of algorithm to identify true PPGL patients

After reviewing health records and confirming or refuting PPGL, we tested various algorithms to identify confirmed PPGL patients among all individuals fulfilling eligibility criteria in the North Denmark Region and Central Denmark Region using only their registry data. Algorithms were successively improved through several iterations to maximize PPV and completeness, as described in the Results section. PPV and completeness are defined in the Data analysis section.

Testing PPV of algorithm in external population

To validate the PPV result of the final optimal algorithm, we used the eligible external population of Region Zealand and the Capital Region of Denmark (average population in study period 2.39 million). Here, health records were reviewed by a second researcher (SFJ) for a random sample of 110 individuals, identified by the algorithm as PPGL patients, and diagnostic ambiguities were scrutinized by an expert (UFR). This was done in order to verify agreement between the conclusion of the algorithm based on registry data and researcher’s conclusion based on health records.

Data analysis

Validity of ICD-8, ICD-10, and SNOMED diagnosis codes was expressed in PPV, defined as the proportion of confirmed PPGL patients among individuals in the validation cohort registered with the specific diagnosis code.

Accuracy of the algorithms was expressed in terms of PPV and completeness. PPV was defined as the proportion of confirmed PPGL patients among individuals in the validation cohort identified by the algorithm as PPGL patients. Completeness was defined as the proportion of confirmed PPGL patients identified by the algorithm in the validation cohort among all confirmed PPGL patients in the validation area. In order not to overestimate completeness, the denominator also included confirmed PPGL patients identified by expanded validation criteria or reported by adrenal specialist, as they did not fulfill eligibility criteria and therefore could never be identified by the algorithm. PPV and completeness were reported with 95% confidence intervals (95% CIs).

Individuals with no available health records were excluded from all calculations of PPV and completeness. Confirmed PPGL patients were excluded from all calculations if diagnosed before 1977 or while living abroad, as they could not be considered incident PPGL cases.

Data management and calculations were performed in Stata Statistical Software: release 13 (StataCorp LP, College Station, TX, USA) and were based on the final dataset received from the Danish Health Authorities on March 22, 2017.

Ethics

The research project was approved by the Danish Data Protection Agency (reference number 2014-41-3198). Permission to review health records without individually informed patient consent was granted by the Danish Health Authorities (reference number 3-3013-1021/1) in accordance with Danish law.

Results

Identification of PPGL cases

A total of 2626 individuals with a PPGL diagnosis code were identified in all of Denmark for the period 1977–2016, whereof 787 (30.0%) lived in the validation area of the North Denmark Region and Central Denmark Region at time of first registered PPGL diagnosis code (Table 4): 688 individuals were identified in the Danish National Patient Registry, 21 in the Danish Registry of Causes of Death, and 214 in the Danish National Pathology Registry. A total of 652 individuals had a PPGL diagnosis in a single registry, 134 had a PPGL diagnosis code in two registries, and one in all three registries.

Table 4 PPGL registrations and validity of diagnosis codes

Notes: Each person can be included in the table with more than one diagnosis code and in more than one registry. aInternational Classification of Diseases 8th edition. bInternational Classification of Disease 10th edition. cSystematized nomenclature of medicine. dIncluding underlying codes. eNine confirmed PPGL patients were excluded as they were diagnosed before 1977 or while living outside Denmark.

Abbreviations: CI, confidence interval; PPGL, pheochromocytoma and catecholamine-secreting paraganglioma; PPV, positive predictive value.

Health records were located and reviewed for 771 (98.0%) of the 787 patients in the validation cohort (Table 4, Figure 1). PPGL was confirmed in 202 patients (26.2%), including 52 confirmed by the expert panel after further scrutinizing 89 cases of doubt. Nine were excluded as they lived abroad at time of diagnosis (N = 2) or were diagnosed before 1977 (N = 7).

In the expanded validation cohort, 913 individuals with a possible PPGL-related diagnosis code had been registered at Department of Endocrinology and Internal Medicine at Aarhus University hospital. Health records were located and reviewed for 816 (89.4%) and an additional four PPGL patients were identified. Further, one additional PPGL patient was reported by the specialist at Department of Endocrinology at Aalborg University Hospital.

In total, a final PPGL cohort of 198 confirmed incident PPGL patients were identified in the North Denmark Region and Central Denmark Region. The median difference between date of first-registered PPGL diagnosis code and date of clinical diagnosis was 0 days (IQR: clinical diagnosis 32 days before to 4 days after).

Validity of PPGL diagnosis codes

Overall, PPV of an ICD-8, ICD-10, or SNOMED diagnosis code for PPGL in any registry was 25.3% (95% CI: 22.3–28.6; Table 4) for confirmed incident PPGL. ICD-8 (255.29) and -10 diagnosis codes (D350A, E275, and R825A) had an overall PPV of 21.7% (95% CI: 18.6–25.0) in the Danish National Patient Registry and 50.0% (95% CI: 26.0–74.0) in the Danish Registry of Causes of Death.

SNOMED diagnosis codes for PPGL (M8700 and S29740) in the Danish National Pathology Registry had a higher overall PPV than the two other health registries at 79.5% (95% CI: 73.4–84.8). Forty-three (20.3%) of 212 individuals registered with pathological diagnosis code “M8700 Pheochromocytoma” did not have PPGL. Of these, thirty-one were refuted as incorrect entries (mainly miscoding of T8700 Ovary or M8720 Naevus), three as non-secreting paragangliomas, five due to a suspicion of PPGL later refuted by further examinations, and four by the expert panel as incorrect diagnoses of PPGL.

Algorithms for identifying PPGL patients

To identify true cases of PPGL using registry data only, we tested different algorithms to obtain as high a PPV and completeness of data as possible by combining data from the three registries.

First, we found that if a person was registered with a PPGL diagnosis code in at least two of the three registries, a PPV of 97.7% (95% CI: 93.4–99.5) was achieved (Table 5). However, the completeness was rather low as this algorithm only identified 127 or 64.1% (95% CI: 57.0–70.8) of the 198 confirmed PPGL patients. Secondly, we found a PPV of 93.6% (95% CI: 88.9–96.8) for PPGL diagnosis codes registered in the Danish National Pathology Registry if the pathological examination had been performed on a relevant tissue or if the patient also had a surgical procedure code for adrenal surgery (086, 088, 090, and KBC) in the Danish National Patient Registry. We defined the examined tissue to be relevant if the pathological examination was registered as an autopsy (material code 31) or with a SNOMED code for either the adrenal glands (T93 and ÆF4330), paraganglioma (T94, T95, M868, and M869), or the body as a whole (T0010).

Table 5 Algorithms for identifying confirmed PPGL patients

Notes: aSee Table 1 for included registries and diagnosis codes. bM8700 or S29740, including underlying codes. cRelevant tissue defined as material code for autopsy “31: deceased body”, or with SNOMED diagnosis codes, including underlying codes: topography codes “T0010: body as a whole”, “T93: adrenal gland” and “T94-95: paraganglioma”, morphology codes “M868-869: paraganglioma” or etiology code “ÆF4330: originated from adrenal gland”. dProcedure codes for adrenal surgery, including underlying codes: “086: explorative incision on adrenal gland”, “088: biopsy of adrenal gland”, “090: adrenalectomy”, and “KBC: surgery on adrenal gland”.

Abbreviations: CI, confidence interval; FP, false positive; FN, false negative; ICD-8, International Classification of Diseases 8th edition; PPGL, pheochromocytoma and catecholamine-secreting paraganglioma; PPV, positive predictive value.

Combined PPGL diagnosis codes in two registries or PPGL pathologically confirmed in a relevant tissue had a PPV of 93.9% (95% CI: 89.3–96.9) and a completeness of 85.4% (95% CI: 79.6–90.0). However, several patients who had died prior to surgery or prior to definitive diagnosis were not identified.

Thirdly, we found that the ICD-8 diagnosis code 255.2 in the Danish Registry of Causes of Death had a PPV of 100.0% (95% CI: 54.1–100.0). The ICD-10 codes had low PPV in the Danish Registry of Causes of Death and were not included in the algorithm.

Finally, a PPGL diagnosis code in the Danish National Patient Registry less than 30 days before date of death identified five PPGL patients who had not been included by the above-mentioned algorithms.

Other attempts to increase the PPV of registrations in the Danish National Patient Registry included restricting to individuals registered at specialized endocrine departments or with at least two or three separate in- or outpatient contacts with PPGL diagnosis codes. This increased PPV but did not contribute with more confirmed PPGL patients and was not included in the final algorithm (Table S2).

The final algorithm, combining the four algorithms above, had a PPV of 93.1% (95%CI: 88.5–96.3). Of the 569 individuals with a PPGL diagnosis code for whom PPGL was refuted, only 13 (2.3%) were falsely identified by the final algorithm as PPGL patients. It identified 176 of the 198 confirmed PPGL patients in our validation area, resulting in a completeness of 88.9% (95% CI: 83.7–92.9). There were no significant differences in sex, age at diagnosis, or year of diagnosis between PPGL patients who were identified by the algorithm and patients who were missed (data not presented).

Subsequently, we applied the final algorithm to the external population of the remaining three regions. The algorithm identified 394 individuals as PPGL patients, of whom we sampled 110 from Region Zealand and the Capital Region of Denmark for external validation of the algorithm. Health records were located for 86 (78.2%), and 82 patients were confirmed as PPGL patients, resulting in an external PPV for incident PPGL of 95.3% (95% CI: 88.5–98.7). Thus, with 198 PPGL patients from our validation area and 394 PPGL patients identified by the algorithm in the other regions minus four for whom PPGL were refuted, we identified a national cohort of 588 PPGL patients.

Discussion

In this population-based study, we have validated ICD-8, ICD-10, and SNOMED diagnosis codes for PPGL. We found that overall PPV was low but varied considerably between diagnosis codes and health registries. However, based on data from 198 confirmed PPGL patients, we developed an algorithm, which identified a national cohort of incident PPGL cases in the registries with high PPV as well as high completeness.

We have no previous studies on validity of PPGL diagnosis codes to compare with, but our results on PPV of diagnosis codes in the Danish National Patient Registry are comparable to similar studies on other rare diseases, which found overall PPV ranging from 34% to 55%.1012 Unsurprisingly, we found that records in the Danish National Pathology Registry had the highest PPV when comparing the three health registries, as pathologists are trained in using the SNOMED system and are responsible for registering their own examinations. In addition, the diagnosis code is routinely updated if new tests on or reexaminations of the tissue leads to another diagnosis.14 In contrast, diagnosis codes in the two other registries are often registered by MDs with only a limited knowledge of the patient and might be registered as a probable, suspected, or even a refuted diagnosis.9,13,16

It is difficult to assess the completeness of the registries, as we do not know how many PPGL patients we missed in our validation area, whether undiagnosed or diagnosed but not registered. However, we have included three complementary registries, found health records for almost all in the validation cohort, and when we examined other possibly PPGL-related diagnosis codes, we only found a few PPGL patients. Therefore, we believe that we have identified the vast majority of the diagnosed PPGL patients in the validation area. Based on our results, we conclude that while most PPGL patients had a PPGL diagnosis code in the Danish National Pathology Registry or the Danish National Patient Registry, no single registry was sufficient to identify a complete cohort of PPGL patients.

The final algorithm identified PPGL patients with a high PPV, which we also validated in an external sample. This is important for future studies on differences in comorbidity and cause-specific mortality for PPGL patients compared to the background population. A high PPV minimizes the risk of misclassification bias, which could otherwise bias results both toward and away from the null hypothesis. Again, assuming we found most diagnosed incident PPGL patients in the validation area, the algorithm also had a high completeness, meaning it also has the potential for monitoring changes in incidence and prevalence of PPGL over time. However, some limitations of the algorithm must be considered. First, even though accuracy of the algorithm did not change during our study period, future changes in registries or coding procedures could both positively and negatively affect PPV and completeness. Secondly, we did not evaluate the completeness of the algorithm in an external population as we did with the PPV of the algorithm. However, giving the uniform organization of the health care system across all Danish regions, including the health registries, we assume that our results can be generalized to the rest of Denmark. Lastly, even though completeness of the algorithm was high, it may miss PPGL patients with a nonclassical clinical course, for example, patients deemed too old or fragile to undergo surgery who therefore might not have been registered in the Danish National Pathology Registry. While this group is quite small and therefore of little concern in regard to incidence and prevalence, it might be of importance if, for example, studying mortality of PPGL patients who do not undergo surgery.

The algorithm was created using Danish health registries, which, together with health registries in the other Scandinavian countries, are internationally considered to be comprehensive and have a high data quality.9 Thus, our results cannot readily be extrapolated to countries with less comprehensive health registries.

Conclusion

Diagnosis codes for pheochromocytoma and catecholamine hypersecretion had a low PPV in several individual health registries in Denmark. However, with a combination of registries, we could identify a near-complete national cohort of incident PPGL patients in Denmark as a valuable source for future epidemiological research.

Acknowledgments

The authors thank the Department of Clinical Medicine at Aarhus University, Aase and Ejnar Danielsen’s Foundation, Department of Endocrinology and Internal Medicine at Aarhus University Hospital, and The Foundation for the Advancement of Medical Science for funding. The sponsors were not involved in designing, executing, or interpreting the study in any way.

The authors thank the following MDs and health professionals as well as their departments for enabling access to medical health records: Aalborg University Hospital, North Denmark Region: Allan Kornmaaler Hansen, Department of Vascular Surgery; Carl Uggerhøj Andersen, Department of Ophthalmology; Christian Pedersen, Department of Orthopedic Surgery; Eva Korup, Department of Cardiology; Gunnar Lauge Nielsen, Department of Medicine in Farsø; Hans Christian Laugaard-Jacobsen, Department of Pediatrics; Helga Gulisano, Department of Neurosurgery; Henrik Christian Bertelsen, Department of Nuclear Medicine; Henrik Jacobsen, Department of Otorhinolaryngology, Head and Neck Surgery; Jan Fallingborg, Department of Gastroenterology; Jens Grønlund, Department of Heart and Lung Surgery; Jette Bertelsen, Department of Medicine in Hobro; Jette Christensen, Department of Pathology; Jørgen Hansen, Department of Oncology; Michael Bjørn Petersen, Department of Clinical Genetics; Niels Henrik Buus, Department of Renal Medicine; Ole Fedders, Department of Neurosurgery; Paw Jensen, Department of Hematology; Poul Erik Jakobsen, Department of Endocrinology; Poul Hedevang Christensen, Department of Orthopedic Surgery in Farsø; Poul Henning Mogensen, Department of Neurology; Stig Andersen, Department of Geriatrics; Thomas Larsen, Department of Gynecology and Obstetrics; Torben Dørflinger, Department of Urology. Aarhus University Hospital, Central Denmark Region: Anne Kaltoft, Department of Cardiology; Anni Ravnsbæk Jensen, Department of Oncology; Else Vestboe, Department of Endocrinology and Internal Medicine; Gitte Kofod Hougaard, Department of Plastic and Breast Surgery; Ida Vogel, Department of Clinical Genetics; Jan Maxwell, Department of Hematology; Jannie Dalby Salvig, Department of Gynecology and Obstetrics; Jens Frederik Dahlerup, Department of Hepatology and Gastroenterology; Karin Lambertsen, Department of Otorhinolaryngology, Head and Neck Surgery; Knud Thygesen Nielsen, Department of Surgery; Lars Bo Ilkjær, Department of Cardiothoracic and Vascular Surgery; Lone Susanne Jensen, Department of Surgery; Marianne Brehmer, Department of Urology; Lone Bo Johansen, Department of Neurosurgery; Mikkel Funding, Department of Ophthalmology; Niels Uldbjerg, Department of Gynecology and Obstetrics; Pernille Hauschildt, Department of Respiratory Diseases and Allergy; Peter Ott, Department of Hepatology and Gastroenterology; Stinne Kvist, Department of Renal Medicine; Torben Steiniche, Department of Pathology. Bispebjerg Hospital, Capital Region of Denmark: Lise Korbo, Department of Neurology. Lillebælt Hospital, Region of Southern Denmark: Annemette Wildfang Lykkebo, Department of Gynecology; Carsten Thordal, Department of Medicine in Kolding; Claus Madsen, Department of Neurology; Ejler Ejlersen, Department of Medicine in Vejle; Hans B Rahr, Department of Surgery in Vejle; Jørn Michael Jepsen, Department of Vascular Surgery; Nasrin Asgari, Department of Neurology. North Denmark Regional Hospital, North Denmark Region: Flemming Knudsen, Department of Surgery in Thisted; Hans-Henrik Lausten-Thomsen, Department of Surgery in Thisted; Henrik Svane Weinreich, Department of Surgery in Frederikshavn and Hjørring; Kim Helge Christiansen, Department of Medicine in Frederikshavn and Hjørring. Regional Hospital Central Jutland, Central Denmark Region: Birgitte Hertz, Department of Pediatrics; Einar Pahle, Department of Surgery; Henning Danielsen, Department of Medicine; Josefine Gradman, Department of Pediatrics; Sonja Kindt, Department of Gynecology and Obstetrics; Tamás Barsi, Department of Urology; Ulrich Fredberg, Diagnostic Center. Regional Hospital Horsens, Central Denmark Region: Jørn Selling Rasmussen, Department of Surgery; Thomas Hahn, Department of Medicine; Tina Pasgaard, Department of Gynecology and Obstetrics. Regional Hospital Randers, Central Denmark Region: Bent Windelborg Nielsen, Department of Pediatrics; Finn Kristian Næser, Department of Ophthalmology; Jan Kjær Pedersen, Department of Ophthalmology; Lene Stouby Mortensen, Department of Medicine. Regional Hospital West Jutland, Central Denmark Region: Jesper Mortensen, Department of Nuclear Medicine; Niels Hald, Department of Surgery; Peder Graversen, Department of Urology; Torben Bæk Hansen, Department of Orthopedic Surgery. Sønderjylland Hospital, Region of Southern Denmark: Thomas Lund Sørensen, Center of Medicine.

Disclosure

The authors report no conflicts of interest in this work.

References

1.

Lenders JW, Duh QY, Eisenhofer G, et al; Endocrine Society. Pheochromocytoma and paraganglioma: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2014;99(6):1915–1942.

2.

Farrugia FA, Martikos G, Surgeon C, et al. Radiology of the adrenal incidentalomas. Review of the literature. Endocr Regul. 2017;51(1):35–51.

3.

Lenders JW, Eisenhofer G, Mannelli M, Pacak K. Phaeochromocytoma. Lancet. 2005;366(9486):665–675.

4.

Assadipour Y, Sadowski SM, Alimchandani M, et al. SDHB mutation status and tumor size but not tumor grade are important predictors of clinical outcome in pheochromocytoma and abdominal paraganglioma. Surgery. 2017;161(1):230–239.

5.

Stolk RF, Bakx C, Mulder J, Timmers HJLM, Lenders JWM. Is the excess cardiovascular morbidity in pheochromocytoma related to blood pressure or to catecholamines? J Clin Endocrinol Metab. 2013;98(3):1100–1106.

6.

Khorram-Manesh A, Ahlman H, Nilsson O, Odén A, Jansson S. Mortality associated with pheochromocytoma in a large Swedish cohort. Eur J Surg Oncol. 2004;30(5):556–559.

7.

Hamidi O, Young WF, Iñiguez-Ariza NM, et al. Malignant pheochromocytoma and paraganglioma: 272 patients over 55 years. J Clin Endocrinol Metab. 2017;102(9):3296–3305.

8.

Schmidt M, Pedersen L, Sørensen HT. The Danish Civil Registration System as a tool in epidemiology. Eur J Epidemiol. 2014;29(8):541–549.

9.

Schmidt M, Schmidt SAJ, Sandegaard JL, Ehrenstein V, Pedersen L, Sørensen HT. The Danish National Patient Registry: a review of content, data quality, and research potential. Clin Epidemiol. 2015;7:449–490.

10.

Nielsen EH, Lindholm J, Laurberg P. Use of combined search criteria improved validity of rare disease (craniopharyngioma) diagnosis in a national registry. J Clin Epidemiol. 2011;64(10):1118–1126.

11.

Dal J, Skou N, Nielsen EH, Jørgensen JOL, Pedersen L. Acromegaly according to the Danish National Registry of patients: how valid are ICD diagnoses and how do patterns of registration affect the accuracy of registry data? Clin Epidemiol. 2014;6(1):295–299.

12.

Berglund A, Olsen M, Andersen M, et al. Evaluation of ICD-10 algorithms to identify hypopituitary patients in the Danish National Patient Registry. Clin Epidemiol. 2017;9:75–82.

13.

Helweg-Larsen K. The Danish register of causes of death. Scand J Public Health. 2011;39(7):26–29.

14.

Erichsen R, Lash TL, Hamilton-Dutoit SJ, Bjerregaard B, Vyberg M, Pedersen L. Existing data sources for clinical epidemiology: the Danish National Pathology Registry and Data Bank. Clin Epidemiol. 2010;2(1):51–56.

15.

National eHealth Authority. Dokumentation af sundhedsregistre [Documentation of health registries]. Available from: http://www.esundhed.dk/dokumentation/Sider/Dokumentation.aspx. Accessed December 4, 2016. Danish.

16.

Sørensen HT, Christensen T, Schlosser HK, Pedersen L, eds. Use of Medical Databases in Clinical Epidemiology. 2nd ed. Aarhus: SUN-TRYK, Aarhus University; 2009. Available from: http://www.kea.au.dk/file/Use_of_medical_databases_in_clinical_epidemiology_2nd_ed_472.pdf. Accessed December 3, 2017.

17.

Statistics Denmark. BEF1: Folketal 1. Januar Efter Kommune, Løn, Alder Og Civilstand (Afsluttet) 1971-2002 [BEF1: By Region, Marital Status, Age, Sex and Time (Discontinued) 1971–2002]. Copenhagen; 2002. Available from: http://statistikbanken.dk/bef1. Accessed October 26, 2017. Danish.

18.

Statistics Denmark. BEF1A: Folketal 1. Januar Efter Kommune, Køn, Alder Og Civilstand (Afsluttet) 1979-2006 [BEF1A: Population 1. January by Municipality, Sex, Age and Marital Status (Discontinued) 1979-2006]. Copenhagen; 2006. Available from: http://statistikbanken.dk/bef1a. Accessed October 26, 2017. Danish.

19.

Statistics Denmark. BEF1A07: Folketal 1. Januar Efter Kommune, Køn, Alder Og Civilstand (Afsluttet) 2005-2009 [BEF1A07: Population 1. January by Municipality, Sex, Age and Marital Status (Discontinued) 2005-2009]. Copenhagen; 2009. Available from: http://statistikbanken.dk/BEF1A07. Accessed October 26, 2017. Danish.

20.

Statistics Denmark. FOLK1A: Folketal Den 1. I Kvartalet Efter Område, Køn, Alder Og Civilstand 2008K1-2017K3 [FOLK1A: Population at the First Day of the Quarter by Region, Sex, Age, Marital Status and Time 2008Q1-2017Q3]. Copenhagen; 2017. Available from: https://www.statbank.dk/FOLK1A. Accessed October 26, 2017. Danish.

Supplementary Materials

Table S1 Important changes in health registries

Note: Data from references 9 and 13 to 16.

Abbreviations: ICD-8, International Classification of Diseases 8th edition; ICD-10, International Classification of Disease 10th edition; SNOMED, Systematized Nomenclature of Medicine.

Table S2 PPV and completeness of diagnosis codes in Danish National Patient Registry by number of in- or outpatient contacts

Notes: aIncluding underlying codes. bNot including referral diagnosis codes to endocrine departments.

Abbreviations: PPV, positive predictive value.

Creative Commons License © 2018 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.