Survey and comparative analysis of entropy and relative entropy thresholding techniques

C. I. Chang, Y. Du, J. Wang, S. M. Guo, P. D. Thouin

Research output: Contribution to journalArticlepeer-review

170 Citations (Scopus)


Entropy-based image thresholding has received considerable interest in recent years. Two types of entropy are generally used as thresholding criteria: Shannon's entropy and relative entropy, also known as Kullback-Leibler information distance, where the former measures uncertainty in an information source with an optimal threshold obtained by maximising Shannon's entropy, whereas the latter measures the information discrepancy between two different sources with an optimal threshold obtained by minimising relative entropy. Many thresholding methods have been developed for both criteria and reported in the literature. These two entropy-based thresholding criteria have been investigated and the relationship among entropy and relative entropy thresholding methods has been explored. In particular, a survey and comparative analysis is conducted among several widely used methods that include Pun and Kapur's maximum entropy, Kittler and Illingworth's minimum error thresholding, Pal and Pal's entropy thresholding and Chang et al.'s relative entropy thresholding methods. In order to objectively assess these methods, two measures, uniformity and shape, are used for performance evaluation.

Original languageEnglish
Pages (from-to)837-850
Number of pages14
JournalIEE Proceedings: Vision, Image and Signal Processing
Issue number6
Publication statusPublished - 2006

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'Survey and comparative analysis of entropy and relative entropy thresholding techniques'. Together they form a unique fingerprint.

Cite this