Validity of registry data: agreement between cancer records in an end-stage kidney disease registry (voluntary reporting) and a cancer register (statutory reporting).

Aims: End-stage kidney disease registries inform outcomes and policy. Data quality is crucial but difficult to measure objectively. We assessed agreement between incident cancer reported to the Australian and New Zealand Dialysis and Transplant Registry (ANZDATA) and to the Central Cancer Registry (CCR) in New South Wales.

Methods: ANZDATA records were linked to CCR using probabilistic matching. We calculated agreement between registries for patients with > or =1 cancers, all cancers and site-specific cancer using the kappa statistic (kappa). We investigated cases where records disagreed and compared estimates of cancer risk based either on ANZDATA or on CCR using standardized incidence ratios (indirect standardization by age, sex and calendar year).

Results: From 1980 to 2001, 9453 residents had dialysis or transplantation. ANZDATA recorded 867 cancers in 779 (8.2%) registrants; CCR 867 cancers in 788 (8.3%). ANZDATA recorded 170 patients with cancer that CCR did not, CCR recorded 179 patients that ANZDATA did not (kappa = 0.76). ANZDATA had sensitivity 77.3% (confidence interval (CI) 74.2-80.2), specificity 98.1% (CI 97.7-98.3) if CCR records were regarded as the reference standard. Agreement was similar for diagnoses while receiving dialysis (kappa = 0.78) or after transplantation (kappa = 0.79), but varied by cancer type. Agreement was poorest for melanoma (kappa = 0.61) and myeloma (kappa = 0.47) and highest for lymphoma (kappa = 0.80), leukaemia (kappa = 0.86) and breast cancer (kappa = 0.85). Artefact accounted for 20.8% of the non-concordance but error and misclassification did occur in both registries. Estimates of cancer risk based on ANZDATA or CCR records did not differ in any important way.

Conclusion: Agreement of cancer records between both registries was high and differences largely explicable. It is likely that both ANZDATA and CCR have some inaccuracies, for reasons that are now more explicit, with themes similar to those likely to be experienced by other registries.