Photo sundial: Estimating the time of capture in consumer photos

Tsung Hung Tsai, Wei Cih Jhou, Wen Huang Cheng, Min Chun Hu, I. Chao Shen, Tekoing Lim, Kai Lung Hua, Ahmed Ghoneim, M. Anwar Hossain, Shintami C. Hidayati

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The time of capture of consumer photos provides rich information in temporal context and has been widely employed for solving various multimedia problems, such as multimedia retrieval and social media analysis. However, we observed that the recorded time stamp in a consumer photo does not often correspond to the true local time at which the photo was taken. This would greatly damage the robustness of time-aware multimedia applications, such as travel route recommendation. Therefore, motivated by the use of traditional sundials, this work proposes a system, Photo Sundial, for estimating the time of capture by exploiting the astronomical theory. In particular, we infer the time by establishing its relations to the measurable astronomical factors from a given outdoor photo, i.e. the sun position in the sky and the camera viewing direction in the photo-taken location. In practice, since it is more often that people would take multiple photos in a single trip, we further develop an optimization framework to jointly estimate the time from multiple photos. Experimental results show that the average estimated time error is less than 0.9 h by the proposed approach, with a significant 65% relative improvement compared to the state-of-the-art method (2.5 h). To the best of our knowledge, this work is the first study in multimedia research to explicitly address the problem of time of capture estimation in consumer photos, and the achieved performances highly encourage our system for practical applications.

Original languageEnglish
Pages (from-to)529-542
Number of pages14
JournalNeurocomputing
Volume177
DOIs
Publication statusPublished - 2016 Feb 12

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Photo sundial: Estimating the time of capture in consumer photos'. Together they form a unique fingerprint.

  • Cite this

    Tsai, T. H., Jhou, W. C., Cheng, W. H., Hu, M. C., Shen, I. C., Lim, T., Hua, K. L., Ghoneim, A., Hossain, M. A., & Hidayati, S. C. (2016). Photo sundial: Estimating the time of capture in consumer photos. Neurocomputing, 177, 529-542. https://doi.org/10.1016/j.neucom.2015.11.050