A Deep Learning-Based Cloud-Edge Healthcare System With Time-of-Flight Cameras

Shuenn Yuh Lee, Ting Yun Huang, Chun Yueh Yen, I. Pei Lee, Ju Yi Chen, Chun Rong Huang

Research output: Contribution to journalArticlepeer-review

Abstract

This study proposes a comprehensive and vision-based long-term healthcare system that includes time-of-flight (ToF) cameras at the front end, the Raspberry Pi at the edge point, and image database and classification at a cloud server. First, the ToF cameras capture human actions through depth maps. Next, the Raspberry Pi accomplishes image preprocessing and sends the resulting images to the cloud server by wireless transmission. Finally, the cloud server performs human action recognition by using the proposed temporal frame correlation recognition model. Our model expands object detection to the 3-D space based on continuous ToF images. Depth maps of ToF images do not record users' identities or environments, which prevents users from committing privacy violations. The study also builds a human action dataset, where each frame is recorded and labeled as five actions including sitting, standing, lying, getting up, and falling. After further optimization in the future, the system can improve the long-term healthcare environment and relieve the burden of nursing on elderly care.

Original languageEnglish
Pages (from-to)7064-7074
Number of pages11
JournalIEEE Sensors Journal
Volume24
Issue number5
DOIs
Publication statusPublished - 2024 Mar 1

All Science Journal Classification (ASJC) codes

  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'A Deep Learning-Based Cloud-Edge Healthcare System With Time-of-Flight Cameras'. Together they form a unique fingerprint.

Cite this