Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor

Research output: Contribution to conferencePaper

Abstract

Satellite imagery have the advantage of rapid and cyclical monitoring of changes in environment, land use, natural resources, etc. Registering a satellite image sequence and further making it into a video by recovering camera poses will strengthen the merit mentioned above. The images used in this study are captured by a push-broom and frame-based camera mounted on an aircraft flying in high altitude, which is used to simulate a micro-satellite, and the images are captured with high frame rate. Frame-to-frame registration between subsequent frames should be done first. Speeded-Up Robust Features (SURF) is the feature-based image matching algorithm used for feature point detection, description and matching, and followed by Random Sample Consensus (RANSAC) to remove the wrong matching pairs. In order to improve the registration accuracy, overcoming the influence of relief displacement on image registration is needed, that is, only the feature points belonging to the ground point are used for registration. Since the features in the images are not coplanar, there is no simple geometric transformation model to describe the relationship between the corresponding image points, which means that we cannot solve the problem of feature point filtering by analyzing the geometric relationship of the corresponding feature point pairs in image space but should solve in the object space. Therefore, we use the corresponding feature points and the camera matrices obtained by camera calibration to recover camera poses and reconstruct the 3D structure of the scene by triangulation methods. Finally, the feature points are filtered by their altitudes to take out the ground points for precise registration and video production.

Original languageEnglish
Pages2077-2083
Number of pages7
Publication statusPublished - 2018 Jan 1
Event39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018 - Kuala Lumpur, Malaysia
Duration: 2018 Oct 152018 Oct 19

Conference

Conference39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018
CountryMalaysia
CityKuala Lumpur
Period18-10-1518-10-19

Fingerprint

Image sensors
Cameras
Satellites
sensor
Recovery
Image matching
Satellite imagery
Image registration
Natural resources
Triangulation
Land use
triangulation
satellite imagery
Aircraft
rate
satellite image
Calibration
aircraft
relief
natural resource

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems
  • Earth and Planetary Sciences(all)
  • Computer Networks and Communications

Cite this

Chang, Y. C., Tseng, Y-H., & Lin, C-H. (2018). Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor. 2077-2083. Paper presented at 39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018, Kuala Lumpur, Malaysia.
Chang, Ya Chu ; Tseng, Yi-Hsing ; Lin, Chao-Hung. / Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor. Paper presented at 39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018, Kuala Lumpur, Malaysia.7 p.
@conference{b78832875ce540a59b6143f1d2f0f2bd,
title = "Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor",
abstract = "Satellite imagery have the advantage of rapid and cyclical monitoring of changes in environment, land use, natural resources, etc. Registering a satellite image sequence and further making it into a video by recovering camera poses will strengthen the merit mentioned above. The images used in this study are captured by a push-broom and frame-based camera mounted on an aircraft flying in high altitude, which is used to simulate a micro-satellite, and the images are captured with high frame rate. Frame-to-frame registration between subsequent frames should be done first. Speeded-Up Robust Features (SURF) is the feature-based image matching algorithm used for feature point detection, description and matching, and followed by Random Sample Consensus (RANSAC) to remove the wrong matching pairs. In order to improve the registration accuracy, overcoming the influence of relief displacement on image registration is needed, that is, only the feature points belonging to the ground point are used for registration. Since the features in the images are not coplanar, there is no simple geometric transformation model to describe the relationship between the corresponding image points, which means that we cannot solve the problem of feature point filtering by analyzing the geometric relationship of the corresponding feature point pairs in image space but should solve in the object space. Therefore, we use the corresponding feature points and the camera matrices obtained by camera calibration to recover camera poses and reconstruct the 3D structure of the scene by triangulation methods. Finally, the feature points are filtered by their altitudes to take out the ground points for precise registration and video production.",
author = "Chang, {Ya Chu} and Yi-Hsing Tseng and Chao-Hung Lin",
year = "2018",
month = "1",
day = "1",
language = "English",
pages = "2077--2083",
note = "39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018 ; Conference date: 15-10-2018 Through 19-10-2018",

}

Chang, YC, Tseng, Y-H & Lin, C-H 2018, 'Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor' Paper presented at 39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018, Kuala Lumpur, Malaysia, 18-10-15 - 18-10-19, pp. 2077-2083.

Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor. / Chang, Ya Chu; Tseng, Yi-Hsing; Lin, Chao-Hung.

2018. 2077-2083 Paper presented at 39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018, Kuala Lumpur, Malaysia.

Research output: Contribution to conferencePaper

TY - CONF

T1 - Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor

AU - Chang, Ya Chu

AU - Tseng, Yi-Hsing

AU - Lin, Chao-Hung

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Satellite imagery have the advantage of rapid and cyclical monitoring of changes in environment, land use, natural resources, etc. Registering a satellite image sequence and further making it into a video by recovering camera poses will strengthen the merit mentioned above. The images used in this study are captured by a push-broom and frame-based camera mounted on an aircraft flying in high altitude, which is used to simulate a micro-satellite, and the images are captured with high frame rate. Frame-to-frame registration between subsequent frames should be done first. Speeded-Up Robust Features (SURF) is the feature-based image matching algorithm used for feature point detection, description and matching, and followed by Random Sample Consensus (RANSAC) to remove the wrong matching pairs. In order to improve the registration accuracy, overcoming the influence of relief displacement on image registration is needed, that is, only the feature points belonging to the ground point are used for registration. Since the features in the images are not coplanar, there is no simple geometric transformation model to describe the relationship between the corresponding image points, which means that we cannot solve the problem of feature point filtering by analyzing the geometric relationship of the corresponding feature point pairs in image space but should solve in the object space. Therefore, we use the corresponding feature points and the camera matrices obtained by camera calibration to recover camera poses and reconstruct the 3D structure of the scene by triangulation methods. Finally, the feature points are filtered by their altitudes to take out the ground points for precise registration and video production.

AB - Satellite imagery have the advantage of rapid and cyclical monitoring of changes in environment, land use, natural resources, etc. Registering a satellite image sequence and further making it into a video by recovering camera poses will strengthen the merit mentioned above. The images used in this study are captured by a push-broom and frame-based camera mounted on an aircraft flying in high altitude, which is used to simulate a micro-satellite, and the images are captured with high frame rate. Frame-to-frame registration between subsequent frames should be done first. Speeded-Up Robust Features (SURF) is the feature-based image matching algorithm used for feature point detection, description and matching, and followed by Random Sample Consensus (RANSAC) to remove the wrong matching pairs. In order to improve the registration accuracy, overcoming the influence of relief displacement on image registration is needed, that is, only the feature points belonging to the ground point are used for registration. Since the features in the images are not coplanar, there is no simple geometric transformation model to describe the relationship between the corresponding image points, which means that we cannot solve the problem of feature point filtering by analyzing the geometric relationship of the corresponding feature point pairs in image space but should solve in the object space. Therefore, we use the corresponding feature points and the camera matrices obtained by camera calibration to recover camera poses and reconstruct the 3D structure of the scene by triangulation methods. Finally, the feature points are filtered by their altitudes to take out the ground points for precise registration and video production.

UR - http://www.scopus.com/inward/record.url?scp=85071848146&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071848146&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85071848146

SP - 2077

EP - 2083

ER -

Chang YC, Tseng Y-H, Lin C-H. Automatic recovery of camera poses based on satellite image sequence captured by a high frame rate image sensor. 2018. Paper presented at 39th Asian Conference on Remote Sensing: Remote Sensing Enabling Prosperity, ACRS 2018, Kuala Lumpur, Malaysia.