Alternative prior assumptions for improving the performance of naïve Bayesian classifiers

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

The prior distribution of an attribute in a naïve Bayesian classifier is typically assumed to be a Dirichlet distribution, and this is called the Dirichlet assumption. The variables in a Dirichlet random vector can never be positively correlated and must have the same confidence level as measured by normalized variance. Both the generalized Dirichlet and the Liouville distributions include the Dirichlet distribution as a special case. These two multivariate distributions, also defined on the unit simplex, are employed to investigate the impact of the Dirichlet assumption in naïve Bayesian classifiers. We propose methods to construct appropriate generalized Dirichlet and Liouville priors for naïve Bayesian classifiers. Our experimental results on 18 data sets reveal that the generalized Dirichlet distribution has the best performance among the three distribution families. Not only is the Dirichlet assumption inappropriate, but also forcing the variables in a prior to be all positively correlated can deteriorate the performance of the naïve Bayesian classifier.

Original languageEnglish
Pages (from-to)183-213
Number of pages31
JournalData Mining and Knowledge Discovery
Volume18
Issue number2
DOIs
Publication statusPublished - 2009 Apr 1

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Alternative prior assumptions for improving the performance of naïve Bayesian classifiers'. Together they form a unique fingerprint.

  • Cite this