Automatic extraction and visualization of human inner structures from endoscopic image sequences

Chia Hsiang Wu, Yi Chiao Chen, Chun Yen Liu, Chien Chen Chang, Yung-Nien Sun

Research output: Contribution to journalConference article

15 Citations (Scopus)

Abstract

Most of the three-dimensional (3-D) reconstructions of human organs rely on medical volume data. In this paper, we propose to use the endoscopic image sequences as a new image modality for surface reconstruction of human organs or tissues. Using the pinhole camera model, the original 3-D points are projected to two-dimensional (2-D) images by multiplying transformation matrices. We assume the intrinsic camera parameters, such as the focal length and principal points, are known and simplify the transformation matrices to only include the camera motion, i.e. camera rotation and translation. Using the factorization method for recovering the shape of the object and the motion of the camera from an image sequence, the 3-D structures are computed. 3-D reconstruction from endoscopie image sequences is a new exploration. It provides additional information that facilitates the understanding for the lesion areas three-dimensionally. And the reconstructed structures directly correspond to the original images and can be rendered with precise texture-mapping easily. It has potential to be used to guide surgery and serve as an alternative data source for constructing new stereo endoscopy systems using one camera.

Original languageEnglish
Pages (from-to)464-473
Number of pages10
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume5369
DOIs
Publication statusPublished - 2004 Jul 5
EventMedical Imaging 2004: Physiology, Function, and Structure from Medical Images - San Diego, CA, United States
Duration: 2004 Feb 152004 Feb 17

Fingerprint

Image Sequence
Visualization
Camera
Cameras
cameras
Transformation Matrix
3D Reconstruction
organs
3D
Pinhole cameras
Principal Points
Endoscopy
Surface reconstruction
pinhole cameras
Texture Mapping
Three-dimensional Reconstruction
Factorization Method
Surface Reconstruction
Factorization
Motion

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

@article{b0e06763b0794c048555a345bfdbc2b3,
title = "Automatic extraction and visualization of human inner structures from endoscopic image sequences",
abstract = "Most of the three-dimensional (3-D) reconstructions of human organs rely on medical volume data. In this paper, we propose to use the endoscopic image sequences as a new image modality for surface reconstruction of human organs or tissues. Using the pinhole camera model, the original 3-D points are projected to two-dimensional (2-D) images by multiplying transformation matrices. We assume the intrinsic camera parameters, such as the focal length and principal points, are known and simplify the transformation matrices to only include the camera motion, i.e. camera rotation and translation. Using the factorization method for recovering the shape of the object and the motion of the camera from an image sequence, the 3-D structures are computed. 3-D reconstruction from endoscopie image sequences is a new exploration. It provides additional information that facilitates the understanding for the lesion areas three-dimensionally. And the reconstructed structures directly correspond to the original images and can be rendered with precise texture-mapping easily. It has potential to be used to guide surgery and serve as an alternative data source for constructing new stereo endoscopy systems using one camera.",
author = "Wu, {Chia Hsiang} and Chen, {Yi Chiao} and Liu, {Chun Yen} and Chang, {Chien Chen} and Yung-Nien Sun",
year = "2004",
month = "7",
day = "5",
doi = "10.1117/12.535880",
language = "English",
volume = "5369",
pages = "464--473",
journal = "Proceedings of SPIE - The International Society for Optical Engineering",
issn = "0277-786X",
publisher = "SPIE",

}

Automatic extraction and visualization of human inner structures from endoscopic image sequences. / Wu, Chia Hsiang; Chen, Yi Chiao; Liu, Chun Yen; Chang, Chien Chen; Sun, Yung-Nien.

In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 5369, 05.07.2004, p. 464-473.

Research output: Contribution to journalConference article

TY - JOUR

T1 - Automatic extraction and visualization of human inner structures from endoscopic image sequences

AU - Wu, Chia Hsiang

AU - Chen, Yi Chiao

AU - Liu, Chun Yen

AU - Chang, Chien Chen

AU - Sun, Yung-Nien

PY - 2004/7/5

Y1 - 2004/7/5

N2 - Most of the three-dimensional (3-D) reconstructions of human organs rely on medical volume data. In this paper, we propose to use the endoscopic image sequences as a new image modality for surface reconstruction of human organs or tissues. Using the pinhole camera model, the original 3-D points are projected to two-dimensional (2-D) images by multiplying transformation matrices. We assume the intrinsic camera parameters, such as the focal length and principal points, are known and simplify the transformation matrices to only include the camera motion, i.e. camera rotation and translation. Using the factorization method for recovering the shape of the object and the motion of the camera from an image sequence, the 3-D structures are computed. 3-D reconstruction from endoscopie image sequences is a new exploration. It provides additional information that facilitates the understanding for the lesion areas three-dimensionally. And the reconstructed structures directly correspond to the original images and can be rendered with precise texture-mapping easily. It has potential to be used to guide surgery and serve as an alternative data source for constructing new stereo endoscopy systems using one camera.

AB - Most of the three-dimensional (3-D) reconstructions of human organs rely on medical volume data. In this paper, we propose to use the endoscopic image sequences as a new image modality for surface reconstruction of human organs or tissues. Using the pinhole camera model, the original 3-D points are projected to two-dimensional (2-D) images by multiplying transformation matrices. We assume the intrinsic camera parameters, such as the focal length and principal points, are known and simplify the transformation matrices to only include the camera motion, i.e. camera rotation and translation. Using the factorization method for recovering the shape of the object and the motion of the camera from an image sequence, the 3-D structures are computed. 3-D reconstruction from endoscopie image sequences is a new exploration. It provides additional information that facilitates the understanding for the lesion areas three-dimensionally. And the reconstructed structures directly correspond to the original images and can be rendered with precise texture-mapping easily. It has potential to be used to guide surgery and serve as an alternative data source for constructing new stereo endoscopy systems using one camera.

UR - http://www.scopus.com/inward/record.url?scp=3042635172&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=3042635172&partnerID=8YFLogxK

U2 - 10.1117/12.535880

DO - 10.1117/12.535880

M3 - Conference article

AN - SCOPUS:3042635172

VL - 5369

SP - 464

EP - 473

JO - Proceedings of SPIE - The International Society for Optical Engineering

JF - Proceedings of SPIE - The International Society for Optical Engineering

SN - 0277-786X

ER -