Spatiotemporal Coherence-Based Annotation Placement for Surveillance Videos

Wei Cheng Wang, Chien Yu Chiou, Chun Rong Huang, Pau-Choo Chung, Wei Yun Huang

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

In this paper, we propose a novel annotation placement approach for revealing information about foreground objects in surveillance videos. To arrange positions of annotations, spatiotemporal coherence between annotations and foreground objects is applied. The annotation placement problem is formulated as an optimization problem with respect to spatiotemporal coherence of annotations and foreground objects. The optimization problem is effectively solved using Markov random fields. To the best of our knowledge, this paper is the first work that discusses and solves the annotation placement problem for surveillance videos by considering the relationships between annotations and foreground objects with trajectories. As shown in the experiments, the proposed approach can arrange annotations based on the moving trajectories of foreground objects and prevent the occlusions between different annotations and foreground objects. It also achieves better quantitative and qualitative results compared with state-of-the-art approaches.

Original languageEnglish
Pages (from-to)787-801
Number of pages15
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume28
Issue number3
DOIs
Publication statusPublished - 2018 Mar 1

Fingerprint

Trajectories
Experiments

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this

Wang, Wei Cheng ; Chiou, Chien Yu ; Huang, Chun Rong ; Chung, Pau-Choo ; Huang, Wei Yun. / Spatiotemporal Coherence-Based Annotation Placement for Surveillance Videos. In: IEEE Transactions on Circuits and Systems for Video Technology. 2018 ; Vol. 28, No. 3. pp. 787-801.
@article{0595b4fe14934ec888f56282ac135e9a,
title = "Spatiotemporal Coherence-Based Annotation Placement for Surveillance Videos",
abstract = "In this paper, we propose a novel annotation placement approach for revealing information about foreground objects in surveillance videos. To arrange positions of annotations, spatiotemporal coherence between annotations and foreground objects is applied. The annotation placement problem is formulated as an optimization problem with respect to spatiotemporal coherence of annotations and foreground objects. The optimization problem is effectively solved using Markov random fields. To the best of our knowledge, this paper is the first work that discusses and solves the annotation placement problem for surveillance videos by considering the relationships between annotations and foreground objects with trajectories. As shown in the experiments, the proposed approach can arrange annotations based on the moving trajectories of foreground objects and prevent the occlusions between different annotations and foreground objects. It also achieves better quantitative and qualitative results compared with state-of-the-art approaches.",
author = "Wang, {Wei Cheng} and Chiou, {Chien Yu} and Huang, {Chun Rong} and Pau-Choo Chung and Huang, {Wei Yun}",
year = "2018",
month = "3",
day = "1",
doi = "10.1109/TCSVT.2016.2629340",
language = "English",
volume = "28",
pages = "787--801",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

Spatiotemporal Coherence-Based Annotation Placement for Surveillance Videos. / Wang, Wei Cheng; Chiou, Chien Yu; Huang, Chun Rong; Chung, Pau-Choo; Huang, Wei Yun.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 28, No. 3, 01.03.2018, p. 787-801.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Spatiotemporal Coherence-Based Annotation Placement for Surveillance Videos

AU - Wang, Wei Cheng

AU - Chiou, Chien Yu

AU - Huang, Chun Rong

AU - Chung, Pau-Choo

AU - Huang, Wei Yun

PY - 2018/3/1

Y1 - 2018/3/1

N2 - In this paper, we propose a novel annotation placement approach for revealing information about foreground objects in surveillance videos. To arrange positions of annotations, spatiotemporal coherence between annotations and foreground objects is applied. The annotation placement problem is formulated as an optimization problem with respect to spatiotemporal coherence of annotations and foreground objects. The optimization problem is effectively solved using Markov random fields. To the best of our knowledge, this paper is the first work that discusses and solves the annotation placement problem for surveillance videos by considering the relationships between annotations and foreground objects with trajectories. As shown in the experiments, the proposed approach can arrange annotations based on the moving trajectories of foreground objects and prevent the occlusions between different annotations and foreground objects. It also achieves better quantitative and qualitative results compared with state-of-the-art approaches.

AB - In this paper, we propose a novel annotation placement approach for revealing information about foreground objects in surveillance videos. To arrange positions of annotations, spatiotemporal coherence between annotations and foreground objects is applied. The annotation placement problem is formulated as an optimization problem with respect to spatiotemporal coherence of annotations and foreground objects. The optimization problem is effectively solved using Markov random fields. To the best of our knowledge, this paper is the first work that discusses and solves the annotation placement problem for surveillance videos by considering the relationships between annotations and foreground objects with trajectories. As shown in the experiments, the proposed approach can arrange annotations based on the moving trajectories of foreground objects and prevent the occlusions between different annotations and foreground objects. It also achieves better quantitative and qualitative results compared with state-of-the-art approaches.

UR - http://www.scopus.com/inward/record.url?scp=85042931375&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85042931375&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2016.2629340

DO - 10.1109/TCSVT.2016.2629340

M3 - Article

VL - 28

SP - 787

EP - 801

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 3

ER -