Precision analysis of visual odometry based on disparity changing

C. Y. Fu, J. R. Tsay

Research output: Contribution to journalConference article

Abstract

This thesis aims to analyze the precision of Position and orientation of cameras on Mobile Mapping System (MMS) determined by disparity based VO (DBVO). Dual forwards taken cameras on MMS are applied to obtain a sequence of stereo pairs. The Interior Orientation Parameters (IOPs) and Relative Orientation Parameters (ROPs) are derived in advance. The pose estimation is achieved by DBVO without additional control data. The procedure of DBVO consists of four steps. First up, keypoint detection and matching is conducted to obtain tie points in consecutive images. Then, image rectification is implemented to transform tie points into epipolar image space. Next, parallax equation is applied to estimate the 3D coordinates of interest points in epipolar image 3D space. Since their image points have different disparity in neighboring stereo pairs, the 3D coordinates of interest points in neighboring pairs are different as well. Finally, 3D conformal transformation is employed to derive the transformation parameters between neighboring pairs according to changing of coordinates of interest points. The posteriori STDs are adopted to assess the quality of transformation. Besides, check data of ground trajectory derived by photo triangulation are applied to evaluate the result. The relative errors of horizontal and vertical translations derived by DBVO are 2% and 3% in non-viewing direction. However, the translation in viewing direction and three rotation angles derived by DBVO have significant systematic errors about 1 m, 3°, 3° and 10° respectively. The influence of error propagation is not significant according to the chart of error distance ratio. In open area, the trajectory of INS/GPS is similar to ground truth, while the trajectory derived by DBVO has 44% relative error. In residential district, the trajectory derived by INS/GPS has drift error about 2 m, while the relative error of the trajectory derived by DBVO decreases to 38%. It is presumed that the systematic error results from 3D coordinates estimated by parallax equation because of poor intersection geometry. It will be proved by adding sideward photographing cameras in the future.

Original languageEnglish
Pages (from-to)113-119
Number of pages7
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Volume42
Issue number2W6
DOIs
Publication statusPublished - 2017 Aug 23
Event4th ISPRS International Conference on Unmanned Aerial Vehicles in Geomatics, UAV-g 2017 - Bonn, Germany
Duration: 2017 Sep 42017 Sep 7

Fingerprint

trajectory
Trajectories
Cameras
Systematic errors
GPS
Global positioning system
triangulation
Triangulation
transform
analysis
geometry
Geometry
mathematics
district
parameter

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Geography, Planning and Development

Cite this

@article{6f189cae9a164cd893f407870b7f7122,
title = "Precision analysis of visual odometry based on disparity changing",
abstract = "This thesis aims to analyze the precision of Position and orientation of cameras on Mobile Mapping System (MMS) determined by disparity based VO (DBVO). Dual forwards taken cameras on MMS are applied to obtain a sequence of stereo pairs. The Interior Orientation Parameters (IOPs) and Relative Orientation Parameters (ROPs) are derived in advance. The pose estimation is achieved by DBVO without additional control data. The procedure of DBVO consists of four steps. First up, keypoint detection and matching is conducted to obtain tie points in consecutive images. Then, image rectification is implemented to transform tie points into epipolar image space. Next, parallax equation is applied to estimate the 3D coordinates of interest points in epipolar image 3D space. Since their image points have different disparity in neighboring stereo pairs, the 3D coordinates of interest points in neighboring pairs are different as well. Finally, 3D conformal transformation is employed to derive the transformation parameters between neighboring pairs according to changing of coordinates of interest points. The posteriori STDs are adopted to assess the quality of transformation. Besides, check data of ground trajectory derived by photo triangulation are applied to evaluate the result. The relative errors of horizontal and vertical translations derived by DBVO are 2{\%} and 3{\%} in non-viewing direction. However, the translation in viewing direction and three rotation angles derived by DBVO have significant systematic errors about 1 m, 3°, 3° and 10° respectively. The influence of error propagation is not significant according to the chart of error distance ratio. In open area, the trajectory of INS/GPS is similar to ground truth, while the trajectory derived by DBVO has 44{\%} relative error. In residential district, the trajectory derived by INS/GPS has drift error about 2 m, while the relative error of the trajectory derived by DBVO decreases to 38{\%}. It is presumed that the systematic error results from 3D coordinates estimated by parallax equation because of poor intersection geometry. It will be proved by adding sideward photographing cameras in the future.",
author = "Fu, {C. Y.} and Tsay, {J. R.}",
year = "2017",
month = "8",
day = "23",
doi = "10.5194/isprs-archives-XLII-2-W6-113-2017",
language = "English",
volume = "42",
pages = "113--119",
journal = "International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives",
issn = "1682-1750",
number = "2W6",

}

TY - JOUR

T1 - Precision analysis of visual odometry based on disparity changing

AU - Fu, C. Y.

AU - Tsay, J. R.

PY - 2017/8/23

Y1 - 2017/8/23

N2 - This thesis aims to analyze the precision of Position and orientation of cameras on Mobile Mapping System (MMS) determined by disparity based VO (DBVO). Dual forwards taken cameras on MMS are applied to obtain a sequence of stereo pairs. The Interior Orientation Parameters (IOPs) and Relative Orientation Parameters (ROPs) are derived in advance. The pose estimation is achieved by DBVO without additional control data. The procedure of DBVO consists of four steps. First up, keypoint detection and matching is conducted to obtain tie points in consecutive images. Then, image rectification is implemented to transform tie points into epipolar image space. Next, parallax equation is applied to estimate the 3D coordinates of interest points in epipolar image 3D space. Since their image points have different disparity in neighboring stereo pairs, the 3D coordinates of interest points in neighboring pairs are different as well. Finally, 3D conformal transformation is employed to derive the transformation parameters between neighboring pairs according to changing of coordinates of interest points. The posteriori STDs are adopted to assess the quality of transformation. Besides, check data of ground trajectory derived by photo triangulation are applied to evaluate the result. The relative errors of horizontal and vertical translations derived by DBVO are 2% and 3% in non-viewing direction. However, the translation in viewing direction and three rotation angles derived by DBVO have significant systematic errors about 1 m, 3°, 3° and 10° respectively. The influence of error propagation is not significant according to the chart of error distance ratio. In open area, the trajectory of INS/GPS is similar to ground truth, while the trajectory derived by DBVO has 44% relative error. In residential district, the trajectory derived by INS/GPS has drift error about 2 m, while the relative error of the trajectory derived by DBVO decreases to 38%. It is presumed that the systematic error results from 3D coordinates estimated by parallax equation because of poor intersection geometry. It will be proved by adding sideward photographing cameras in the future.

AB - This thesis aims to analyze the precision of Position and orientation of cameras on Mobile Mapping System (MMS) determined by disparity based VO (DBVO). Dual forwards taken cameras on MMS are applied to obtain a sequence of stereo pairs. The Interior Orientation Parameters (IOPs) and Relative Orientation Parameters (ROPs) are derived in advance. The pose estimation is achieved by DBVO without additional control data. The procedure of DBVO consists of four steps. First up, keypoint detection and matching is conducted to obtain tie points in consecutive images. Then, image rectification is implemented to transform tie points into epipolar image space. Next, parallax equation is applied to estimate the 3D coordinates of interest points in epipolar image 3D space. Since their image points have different disparity in neighboring stereo pairs, the 3D coordinates of interest points in neighboring pairs are different as well. Finally, 3D conformal transformation is employed to derive the transformation parameters between neighboring pairs according to changing of coordinates of interest points. The posteriori STDs are adopted to assess the quality of transformation. Besides, check data of ground trajectory derived by photo triangulation are applied to evaluate the result. The relative errors of horizontal and vertical translations derived by DBVO are 2% and 3% in non-viewing direction. However, the translation in viewing direction and three rotation angles derived by DBVO have significant systematic errors about 1 m, 3°, 3° and 10° respectively. The influence of error propagation is not significant according to the chart of error distance ratio. In open area, the trajectory of INS/GPS is similar to ground truth, while the trajectory derived by DBVO has 44% relative error. In residential district, the trajectory derived by INS/GPS has drift error about 2 m, while the relative error of the trajectory derived by DBVO decreases to 38%. It is presumed that the systematic error results from 3D coordinates estimated by parallax equation because of poor intersection geometry. It will be proved by adding sideward photographing cameras in the future.

UR - http://www.scopus.com/inward/record.url?scp=85030217998&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030217998&partnerID=8YFLogxK

U2 - 10.5194/isprs-archives-XLII-2-W6-113-2017

DO - 10.5194/isprs-archives-XLII-2-W6-113-2017

M3 - Conference article

AN - SCOPUS:85030217998

VL - 42

SP - 113

EP - 119

JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives

SN - 1682-1750

IS - 2W6

ER -