Semi-automatic sign board reconstruction from a land vehicle mobile mapping system

Yu Chun Yen, Po Chia Yeha, Jiann Yeou Rau

研究成果: Conference contribution

1 引文 (Scopus)

摘要

There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

原文English
主出版物標題33rd Asian Conference on Remote Sensing 2012, ACRS 2012
頁面1228-1235
頁數8
出版狀態Published - 2012 十二月 1
事件33rd Asian Conference on Remote Sensing 2012, ACRS 2012 - Pattaya, Thailand
持續時間: 2012 十一月 262012 十一月 30

出版系列

名字33rd Asian Conference on Remote Sensing 2012, ACRS 2012
2

Other

Other33rd Asian Conference on Remote Sensing 2012, ACRS 2012
國家Thailand
城市Pattaya
期間12-11-2612-11-30

指紋

Cameras
Image resolution
Railroad cars
Semantics
Detectors

All Science Journal Classification (ASJC) codes

  • Information Systems

引用此文

Yen, Y. C., Yeha, P. C., & Rau, J. Y. (2012). Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. 於 33rd Asian Conference on Remote Sensing 2012, ACRS 2012 (頁 1228-1235). (33rd Asian Conference on Remote Sensing 2012, ACRS 2012; 卷 2).
Yen, Yu Chun ; Yeha, Po Chia ; Rau, Jiann Yeou. / Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. 2012. 頁 1228-1235 (33rd Asian Conference on Remote Sensing 2012, ACRS 2012).
@inproceedings{71119d96e6ef429f922c7edff7e99bec,
title = "Semi-automatic sign board reconstruction from a land vehicle mobile mapping system",
abstract = "There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.",
author = "Yen, {Yu Chun} and Yeha, {Po Chia} and Rau, {Jiann Yeou}",
year = "2012",
month = "12",
day = "1",
language = "English",
isbn = "9781622769742",
series = "33rd Asian Conference on Remote Sensing 2012, ACRS 2012",
pages = "1228--1235",
booktitle = "33rd Asian Conference on Remote Sensing 2012, ACRS 2012",

}

Yen, YC, Yeha, PC & Rau, JY 2012, Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. 於 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. 33rd Asian Conference on Remote Sensing 2012, ACRS 2012, 卷 2, 頁 1228-1235, 33rd Asian Conference on Remote Sensing 2012, ACRS 2012, Pattaya, Thailand, 12-11-26.

Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. / Yen, Yu Chun; Yeha, Po Chia; Rau, Jiann Yeou.

33rd Asian Conference on Remote Sensing 2012, ACRS 2012. 2012. p. 1228-1235 (33rd Asian Conference on Remote Sensing 2012, ACRS 2012; 卷 2).

研究成果: Conference contribution

TY - GEN

T1 - Semi-automatic sign board reconstruction from a land vehicle mobile mapping system

AU - Yen, Yu Chun

AU - Yeha, Po Chia

AU - Rau, Jiann Yeou

PY - 2012/12/1

Y1 - 2012/12/1

N2 - There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

AB - There is lots of semantic information in the sign board related to its corresponding building. For example, we can realize the property of the shop via the sign board. Previous study on sign board detection and recognition from mobile mapping system (MMS) is rare. However, if this process could be done automatically, it will increase the efficiency for POI (point of interest) collection. In this paper, we capture the street view images from a land vehicle MMS, which was configured with three stereo cameras by viewing the front of car and two street sides. At first, we detect straight line-segments by an open source called Line Segmentation Detector (LSD) and perform semi-automatic line-segment matching, then using line-plane intersection algorithm for space intersection to obtain the sign board boundary on the object space. Finally, we perform geometrical reconstruction to get 3D model of the sign board, based on the assumption that the sign board is made in a thin plate. In this study, some factors affect the line segment detection will be analyzed, such as shadow, occlusion, and shape of the sign board, image resolution, and geometric distortion introduced by cameras' viewing angles. Experimental results show that the above mentioned effects will decline the successful rate; particularly the shape of sign board must be complete and clear. Meanwhile, the scale change within the image will introduce spatial resolution variation, thus further studies are necessary to cope with those deficiencies in order to increase the success rate, reliability and robustness. Nevertheless, two successful examples will be illustrated to demonstrate its potential in POI collection.

UR - http://www.scopus.com/inward/record.url?scp=84880006488&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84880006488&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84880006488

SN - 9781622769742

T3 - 33rd Asian Conference on Remote Sensing 2012, ACRS 2012

SP - 1228

EP - 1235

BT - 33rd Asian Conference on Remote Sensing 2012, ACRS 2012

ER -

Yen YC, Yeha PC, Rau JY. Semi-automatic sign board reconstruction from a land vehicle mobile mapping system. 於 33rd Asian Conference on Remote Sensing 2012, ACRS 2012. 2012. p. 1228-1235. (33rd Asian Conference on Remote Sensing 2012, ACRS 2012).