Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications

Chih Chung Hsu, Li Wei Kang, Shih Yu Chen, I. Shan Wang, Ching Hao Hong, Chuan Yu Chang

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)


Autonomous vehicles need to continuously navigate complex traffic environments by efficiently analyzing the surrounding scene, understanding the behavior of other traffic agents, and predicting their future trajectories. The primary objective is to draw up a safe motion and reduce the reaction time for possibly imminent hazards. The main problem addressed in this paper is to explore the movement patterns of surrounding traffic-agents and accurately predict their future trajectories for assisting the vehicle to make a reasonable decision. Traditional trajectory prediction modules require explicit coordinate information to model the interaction between the autonomous car and its surrounding vehicles. However, it is hard to know the real coordinate of surrounding vehicles in real-world scenarios without communications between vehicles. A GAN (generative adversarial network)-based deep learning framework is presented in this paper for predicting the trajectories of surrounding vehicles of an autonomous vehicle in an RGB image sequence without explicit coordinate annotation to solve this problem. To automatically predict the trajectory from RGB image sequences, a coordinate augmentation module and a coordinate stabilization module are proposed to extract the historical trajectory from an image sequence. Meanwhile, the self-attention mechanism is also proposed to improve the social pooling module for better capturing the context information of trajectories of surrounding vehicles. Experimental results are demonstrated that the proposed method is effective and efficient.

Original languageEnglish
Pages (from-to)10763-10780
Number of pages18
JournalMultimedia Tools and Applications
Issue number7
Publication statusPublished - 2023 Mar

All Science Journal Classification (ASJC) codes

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications


Dive into the research topics of 'Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications'. Together they form a unique fingerprint.

Cite this