A factor-adjusted multiple testing procedure for ERP data analysis

David Causeur, Mei Chen Chu, ShuLan Hsieh, Ching-Fan Sheu

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Event-related potentials (ERPs) are now widely collected in psychological research to determine the time courses of mental events. When event-related potentials from treatment conditions are compared, often there is no a priori information on when or how long the differences should occur. Testing simultaneously for differences over the entire set of time points creates a serious multiple comparison problem in which the probability of false positive errors must be controlled, while maintaining reasonable power for correct detection. In this work, we extend the factor-adjusted multiple testing procedure developed by Friguet, Kloareg, and Causeur (Journal of the American Statistical Association, 104, 1406-1415, 2009) to manage the multiplicity problem in ERP data analysis and compare its performance with that of the Benjamini and Hochberg (Journal of the Royal Statistical Society B, 57, 289-300, 1995) false discovery rate procedure, using simulations. The proposed procedure outperformed the latter in detecting more truly significant time points, in addition to reducing the variability of the false discovery rate, suggesting that corrections for mass multiple testings of ERPs can be much improved by modeling the strong local temporal dependencies.

Original languageEnglish
Pages (from-to)635-643
Number of pages9
JournalBehavior Research Methods
Volume44
Issue number3
DOIs
Publication statusPublished - 2012 Sep 1

Fingerprint

Evoked Potentials
Psychology
Event-related Potentials
Testing
Research

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Psychology (miscellaneous)
  • Psychology(all)

Cite this

@article{88c4e5770a0e45f8ade345b2fa734ac9,
title = "A factor-adjusted multiple testing procedure for ERP data analysis",
abstract = "Event-related potentials (ERPs) are now widely collected in psychological research to determine the time courses of mental events. When event-related potentials from treatment conditions are compared, often there is no a priori information on when or how long the differences should occur. Testing simultaneously for differences over the entire set of time points creates a serious multiple comparison problem in which the probability of false positive errors must be controlled, while maintaining reasonable power for correct detection. In this work, we extend the factor-adjusted multiple testing procedure developed by Friguet, Kloareg, and Causeur (Journal of the American Statistical Association, 104, 1406-1415, 2009) to manage the multiplicity problem in ERP data analysis and compare its performance with that of the Benjamini and Hochberg (Journal of the Royal Statistical Society B, 57, 289-300, 1995) false discovery rate procedure, using simulations. The proposed procedure outperformed the latter in detecting more truly significant time points, in addition to reducing the variability of the false discovery rate, suggesting that corrections for mass multiple testings of ERPs can be much improved by modeling the strong local temporal dependencies.",
author = "David Causeur and Chu, {Mei Chen} and ShuLan Hsieh and Ching-Fan Sheu",
year = "2012",
month = "9",
day = "1",
doi = "10.3758/s13428-012-0230-0",
language = "English",
volume = "44",
pages = "635--643",
journal = "Behavior Research Methods",
issn = "1554-351X",
publisher = "Springer New York",
number = "3",

}

A factor-adjusted multiple testing procedure for ERP data analysis. / Causeur, David; Chu, Mei Chen; Hsieh, ShuLan; Sheu, Ching-Fan.

In: Behavior Research Methods, Vol. 44, No. 3, 01.09.2012, p. 635-643.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A factor-adjusted multiple testing procedure for ERP data analysis

AU - Causeur, David

AU - Chu, Mei Chen

AU - Hsieh, ShuLan

AU - Sheu, Ching-Fan

PY - 2012/9/1

Y1 - 2012/9/1

N2 - Event-related potentials (ERPs) are now widely collected in psychological research to determine the time courses of mental events. When event-related potentials from treatment conditions are compared, often there is no a priori information on when or how long the differences should occur. Testing simultaneously for differences over the entire set of time points creates a serious multiple comparison problem in which the probability of false positive errors must be controlled, while maintaining reasonable power for correct detection. In this work, we extend the factor-adjusted multiple testing procedure developed by Friguet, Kloareg, and Causeur (Journal of the American Statistical Association, 104, 1406-1415, 2009) to manage the multiplicity problem in ERP data analysis and compare its performance with that of the Benjamini and Hochberg (Journal of the Royal Statistical Society B, 57, 289-300, 1995) false discovery rate procedure, using simulations. The proposed procedure outperformed the latter in detecting more truly significant time points, in addition to reducing the variability of the false discovery rate, suggesting that corrections for mass multiple testings of ERPs can be much improved by modeling the strong local temporal dependencies.

AB - Event-related potentials (ERPs) are now widely collected in psychological research to determine the time courses of mental events. When event-related potentials from treatment conditions are compared, often there is no a priori information on when or how long the differences should occur. Testing simultaneously for differences over the entire set of time points creates a serious multiple comparison problem in which the probability of false positive errors must be controlled, while maintaining reasonable power for correct detection. In this work, we extend the factor-adjusted multiple testing procedure developed by Friguet, Kloareg, and Causeur (Journal of the American Statistical Association, 104, 1406-1415, 2009) to manage the multiplicity problem in ERP data analysis and compare its performance with that of the Benjamini and Hochberg (Journal of the Royal Statistical Society B, 57, 289-300, 1995) false discovery rate procedure, using simulations. The proposed procedure outperformed the latter in detecting more truly significant time points, in addition to reducing the variability of the false discovery rate, suggesting that corrections for mass multiple testings of ERPs can be much improved by modeling the strong local temporal dependencies.

UR - http://www.scopus.com/inward/record.url?scp=84865654595&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84865654595&partnerID=8YFLogxK

U2 - 10.3758/s13428-012-0230-0

DO - 10.3758/s13428-012-0230-0

M3 - Article

VL - 44

SP - 635

EP - 643

JO - Behavior Research Methods

JF - Behavior Research Methods

SN - 1554-351X

IS - 3

ER -