Test of equivalence and non-inferiority for diagnostic accuracy based on the paired areas under ROC curves

Jen Pei Liu, Mi Chia Ma, Chin Yu Wu, Jia Yen Tai

Research output: Contribution to journalArticlepeer-review

34 Citations (Scopus)


Assessment of equivalence or non-inferiority in accuracy between two diagnostic procedures often involves comparisons of paired areas under the receiver operating characteristic (ROC) curves. With some pre-specified clinically meaningful limits, the current approach to evaluating equivalence is to perform the two one-sided tests (TOST) based on the difference in paired areas under ROC curves estimated by the non-parametric method. We propose to use the standardized difference for assessing equivalence or non-inferiority in diagnostic accuracy based on paired areas under ROC curves between two diagnostic procedures. The bootstrap technique is also suggested for both non-parametric method and the standardized difference approach. A simulation study was conducted empirically to investigate the size and power of the four methods for various combinations of distributions, data types, sample sizes, and different correlations. Simulation results demonstrate that the bootstrap procedure of the standardized difference approach not only can adequately control the type I error rate at the nominal level but also provides equivalent power under both symmetrical and skewed distributions. A numerical example using published data illustrates the proposed methods.

Original languageEnglish
Pages (from-to)1219-1238
Number of pages20
JournalStatistics in Medicine
Issue number7
Publication statusPublished - 2006 Apr 15

All Science Journal Classification (ASJC) codes

  • Epidemiology
  • Statistics and Probability


Dive into the research topics of 'Test of equivalence and non-inferiority for diagnostic accuracy based on the paired areas under ROC curves'. Together they form a unique fingerprint.

Cite this