3D/2D model-to-image registration for quantitative dietary assessment

Hsin Chen Chen, Wenyan Jia, Zhaoxin Li, Yung Nien Sun, Mingui Sun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Citations (Scopus)

Abstract

Image-based dietary assessment is important for health monitoring and management because it can provide quantitative and objective information, such as food volume, nutrition type, and calorie intake. In this paper, a new framework, 3D/2D model-to-image registration, is presented for estimating food volume from a single-view 2D image containing a reference object (i.e., a circular dining plate). First, the food is segmented from the background image based on Otsu's thresholding and morphological operations. Next, the food volume is obtained from a user-selected, 3D shape model. The position, orientation and scale of the model are optimized by a model-to-image registration process. Then, the circular plate in the image is fitted and its spatial information is used as constraints for solving the registration problem. Our method takes the global contour information of the shape model into account to obtain a reliable food volume estimate. Experimental results using regularly shaped test objects and realistically shaped food models with known volumes both demonstrate the effectiveness of our method.

Original languageEnglish
Title of host publication2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012
Pages95-96
Number of pages2
DOIs
Publication statusPublished - 2012 Jun 29
Event38th Annual Northeast Bioengineering Conference, NEBEC 2012 - Philadelphia, PA, United States
Duration: 2012 Mar 162012 Mar 18

Publication series

Name2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012

Other

Other38th Annual Northeast Bioengineering Conference, NEBEC 2012
CountryUnited States
CityPhiladelphia, PA
Period12-03-1612-03-18

Fingerprint

Image registration
Nutrition
Health
Monitoring

All Science Journal Classification (ASJC) codes

  • Bioengineering

Cite this

Chen, H. C., Jia, W., Li, Z., Sun, Y. N., & Sun, M. (2012). 3D/2D model-to-image registration for quantitative dietary assessment. In 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012 (pp. 95-96). [6206979] (2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012). https://doi.org/10.1109/NEBC.2012.6206979
Chen, Hsin Chen ; Jia, Wenyan ; Li, Zhaoxin ; Sun, Yung Nien ; Sun, Mingui. / 3D/2D model-to-image registration for quantitative dietary assessment. 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012. 2012. pp. 95-96 (2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012).
@inproceedings{92146390e0b949379e07c2c44a68df70,
title = "3D/2D model-to-image registration for quantitative dietary assessment",
abstract = "Image-based dietary assessment is important for health monitoring and management because it can provide quantitative and objective information, such as food volume, nutrition type, and calorie intake. In this paper, a new framework, 3D/2D model-to-image registration, is presented for estimating food volume from a single-view 2D image containing a reference object (i.e., a circular dining plate). First, the food is segmented from the background image based on Otsu's thresholding and morphological operations. Next, the food volume is obtained from a user-selected, 3D shape model. The position, orientation and scale of the model are optimized by a model-to-image registration process. Then, the circular plate in the image is fitted and its spatial information is used as constraints for solving the registration problem. Our method takes the global contour information of the shape model into account to obtain a reliable food volume estimate. Experimental results using regularly shaped test objects and realistically shaped food models with known volumes both demonstrate the effectiveness of our method.",
author = "Chen, {Hsin Chen} and Wenyan Jia and Zhaoxin Li and Sun, {Yung Nien} and Mingui Sun",
year = "2012",
month = "6",
day = "29",
doi = "10.1109/NEBC.2012.6206979",
language = "English",
isbn = "9781467311410",
series = "2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012",
pages = "95--96",
booktitle = "2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012",

}

Chen, HC, Jia, W, Li, Z, Sun, YN & Sun, M 2012, 3D/2D model-to-image registration for quantitative dietary assessment. in 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012., 6206979, 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012, pp. 95-96, 38th Annual Northeast Bioengineering Conference, NEBEC 2012, Philadelphia, PA, United States, 12-03-16. https://doi.org/10.1109/NEBC.2012.6206979

3D/2D model-to-image registration for quantitative dietary assessment. / Chen, Hsin Chen; Jia, Wenyan; Li, Zhaoxin; Sun, Yung Nien; Sun, Mingui.

2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012. 2012. p. 95-96 6206979 (2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - 3D/2D model-to-image registration for quantitative dietary assessment

AU - Chen, Hsin Chen

AU - Jia, Wenyan

AU - Li, Zhaoxin

AU - Sun, Yung Nien

AU - Sun, Mingui

PY - 2012/6/29

Y1 - 2012/6/29

N2 - Image-based dietary assessment is important for health monitoring and management because it can provide quantitative and objective information, such as food volume, nutrition type, and calorie intake. In this paper, a new framework, 3D/2D model-to-image registration, is presented for estimating food volume from a single-view 2D image containing a reference object (i.e., a circular dining plate). First, the food is segmented from the background image based on Otsu's thresholding and morphological operations. Next, the food volume is obtained from a user-selected, 3D shape model. The position, orientation and scale of the model are optimized by a model-to-image registration process. Then, the circular plate in the image is fitted and its spatial information is used as constraints for solving the registration problem. Our method takes the global contour information of the shape model into account to obtain a reliable food volume estimate. Experimental results using regularly shaped test objects and realistically shaped food models with known volumes both demonstrate the effectiveness of our method.

AB - Image-based dietary assessment is important for health monitoring and management because it can provide quantitative and objective information, such as food volume, nutrition type, and calorie intake. In this paper, a new framework, 3D/2D model-to-image registration, is presented for estimating food volume from a single-view 2D image containing a reference object (i.e., a circular dining plate). First, the food is segmented from the background image based on Otsu's thresholding and morphological operations. Next, the food volume is obtained from a user-selected, 3D shape model. The position, orientation and scale of the model are optimized by a model-to-image registration process. Then, the circular plate in the image is fitted and its spatial information is used as constraints for solving the registration problem. Our method takes the global contour information of the shape model into account to obtain a reliable food volume estimate. Experimental results using regularly shaped test objects and realistically shaped food models with known volumes both demonstrate the effectiveness of our method.

UR - http://www.scopus.com/inward/record.url?scp=84862748708&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862748708&partnerID=8YFLogxK

U2 - 10.1109/NEBC.2012.6206979

DO - 10.1109/NEBC.2012.6206979

M3 - Conference contribution

AN - SCOPUS:84862748708

SN - 9781467311410

T3 - 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012

SP - 95

EP - 96

BT - 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012

ER -

Chen HC, Jia W, Li Z, Sun YN, Sun M. 3D/2D model-to-image registration for quantitative dietary assessment. In 2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012. 2012. p. 95-96. 6206979. (2012 38th Annual Northeast Bioengineering Conference, NEBEC 2012). https://doi.org/10.1109/NEBC.2012.6206979