Semi-automatic sign board reconstruction from a land vehicle mobile mapping system

Yu Chun Yen, Po Chia Yeha, Jiann-Yeou Rau

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

Original languageEnglish
Title of host publication33rd Asian Conference on Remote Sensing 2012, ACRS 2012
Pages1228-1235
Number of pages8
Volume2
Publication statusPublished - 2012
Event33rd Asian Conference on Remote Sensing 2012, ACRS 2012 - Pattaya, Thailand
Duration: 2012 Nov 262012 Nov 30

Other

Other33rd Asian Conference on Remote Sensing 2012, ACRS 2012
CountryThailand
CityPattaya
Period12-11-2612-11-30

Fingerprint

Cameras
Image resolution
Railroad cars
Semantics
Detectors

All Science Journal Classification (ASJC) codes

  • Information Systems

Cite this

Yen, Y. C., Yeha, P. C., & Rau, J-Y. (2012). Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. In 33rd Asian Conference on Remote Sensing 2012, ACRS 2012 (Vol. 2, pp. 1228-1235)
Yen, Yu Chun ; Yeha, Po Chia ; Rau, Jiann-Yeou. / Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. Vol. 2 2012. pp. 1228-1235
@inproceedings{71119d96e6ef429f922c7edff7e99bec,
title = "Semi-automatic sign board reconstruction from a land vehicle mobile mapping system",
abstract = "There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.",
author = "Yen, {Yu Chun} and Yeha, {Po Chia} and Jiann-Yeou Rau",
year = "2012",
language = "English",
isbn = "9781622769742",
volume = "2",
pages = "1228--1235",
booktitle = "33rd Asian Conference on Remote Sensing 2012, ACRS 2012",

}

Yen, YC, Yeha, PC & Rau, J-Y 2012, Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. in 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. vol. 2, pp. 1228-1235, 33rd Asian Conference on Remote Sensing 2012, ACRS 2012, Pattaya, Thailand, 12-11-26.

Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. / Yen, Yu Chun; Yeha, Po Chia; Rau, Jiann-Yeou.

33rd Asian Conference on Remote Sensing 2012, ACRS 2012. Vol. 2 2012. p. 1228-1235.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Semi-automatic sign board reconstruction from a land vehicle mobile mapping system

AU - Yen, Yu Chun

AU - Yeha, Po Chia

AU - Rau, Jiann-Yeou

PY - 2012

Y1 - 2012

N2 - There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

AB - There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

UR - http://www.scopus.com/inward/record.url?scp=84880006488&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84880006488&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781622769742

VL - 2

SP - 1228

EP - 1235

BT - 33rd Asian Conference on Remote Sensing 2012, ACRS 2012

ER -

Yen YC, Yeha PC, Rau J-Y. Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. In 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. Vol. 2. 2012. p. 1228-1235