Deep Learning-based System for Real-time Segmented Timing and Acceleration Analysis in Swimming

Fu Sung Lin, Ying Hsien Chen, Yu Hao Li, Yu Wen Huang, Tsang Hai Huang, Chih Hsien Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Computer vision-based motion tracking has gained significant attention in various areas including sports. We developed a deep learning (DL)-based system combined with object tracking techniques to track swimmers' information in swimming using real-time automatic segmented timing. The proposed system improved the efficiency of swimmer training and enabled coaches and athletes to evaluate their performance and adjust their practice methods. The system incorporated a YOLOv4-tiny tracking model to detect and track swimmers in real-time. This model was trained with approximately 100,000 images captured by underwater and above-water cameras. The system continuously tracked and marked the swimmers' positions using bounding boxes (Bbox). Segmented timing was determined by analyzing the time for the bounding box to cross predefined reference lines within the image. The system also used side-view image tracking, too to detect swimmer positions. Swimming data were displayed including segmented timing. The proposed system offered benefits for swimmers and coaches. Swimmers could monitor their progress, track their swim speed, and improve performance. Coaches evaluated swimming techniques, identified what to improve, and customized training plans based on real-time feedback and detailed analysis. The real-time automatic segmented timing and display of swimmers' tracking data provided a comprehensive overview of the performance and efficient training in swimming.

Original languageEnglish
Title of host publicationProceedings of the 2023 IEEE 6th International Conference on Knowledge Innovation and Invention, ICKII 2023
EditorsTeen-Hang Meen
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages332-334
Number of pages3
ISBN (Electronic)9798350323535
DOIs
Publication statusPublished - 2023
Event6th IEEE International Conference on Knowledge Innovation and Invention, ICKII 2023 - Sapporo, Japan
Duration: 2023 Aug 112023 Aug 13

Publication series

NameProceedings of the 2023 IEEE 6th International Conference on Knowledge Innovation and Invention, ICKII 2023

Conference

Conference6th IEEE International Conference on Knowledge Innovation and Invention, ICKII 2023
Country/TerritoryJapan
CitySapporo
Period23-08-1123-08-13

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Software
  • Decision Sciences (miscellaneous)
  • Information Systems and Management
  • Control and Systems Engineering
  • Control and Optimization
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Deep Learning-based System for Real-time Segmented Timing and Acceleration Analysis in Swimming'. Together they form a unique fingerprint.

Cite this