A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning

Ying Cih Kao, Cheng Wen Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Increasing urban congestion is a common problem in big cities all over the world. Some Adaptive traffic control (ATC) systems have been proposed to reduce the total travel delay time, which is the main factor of congestion cost. However, previous solutions need a great number of sensors and hardware devices, which are hard to deploy. Fortunately, the advent of advanced Internet of Things (IoT) has made possible more effective and efficient solutions for the congestion issue. Besides, with the availability of the Machine Learning (ML) models, there is hope that the ATC system can be improved with the IoT approach, adopting the ML models. In this paper, we propose a machine learning model for adaptive traffic light control system. First, we assume traffic data is collected from internet-connected IOT sensing devices in vehicles on the roads. Next, the proposed machine learning model receives the data analyzed in cloud, and generates an optimal traffic light period as output. Finally, the optimal traffic light period is transformed to traffic light setting signals to be delivered to the IoT actuating devices in the crossroads. For verifying the proposed model, we build a traffic simulator. For a 24-hour simulated period, the proposed model reduces 55.7% waiting time and 12.76% maximum road occupancy on average, as compared with the Fixed Traffic Light Control System (FTLCS). We also simulate different traffic levels, and our model performs consistently better than the FTLCS in the overall waiting time and maximum road occupancy. The experimental results show that the proposed model is able to alleviate the traffic congestion problem.

Original languageEnglish
Title of host publicationConference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018
EditorsMichael B. Matthews
PublisherIEEE Computer Society
Pages2060-2064
Number of pages5
ISBN (Electronic)9781538692189
DOIs
Publication statusPublished - 2019 Feb 19
Event52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018 - Pacific Grove, United States
Duration: 2018 Oct 282018 Oct 31

Publication series

NameConference Record - Asilomar Conference on Signals, Systems and Computers
Volume2018-October
ISSN (Print)1058-6393

Conference

Conference52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018
CountryUnited States
CityPacific Grove
Period18-10-2818-10-31

Fingerprint

Self organizing maps
Reinforcement learning
Telecommunication traffic
Control systems
Learning systems
Traffic control
Traffic congestion
Time delay
Simulators
Availability
Internet
Hardware
Sensors

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Computer Networks and Communications

Cite this

Kao, Y. C., & Wu, C. W. (2019). A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning. In M. B. Matthews (Ed.), Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018 (pp. 2060-2064). [8645125] (Conference Record - Asilomar Conference on Signals, Systems and Computers; Vol. 2018-October). IEEE Computer Society. https://doi.org/10.1109/ACSSC.2018.8645125
Kao, Ying Cih ; Wu, Cheng Wen. / A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning. Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018. editor / Michael B. Matthews. IEEE Computer Society, 2019. pp. 2060-2064 (Conference Record - Asilomar Conference on Signals, Systems and Computers).
@inproceedings{e2c2536610b44fa6877e6cf64bcd9393,
title = "A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning",
abstract = "Increasing urban congestion is a common problem in big cities all over the world. Some Adaptive traffic control (ATC) systems have been proposed to reduce the total travel delay time, which is the main factor of congestion cost. However, previous solutions need a great number of sensors and hardware devices, which are hard to deploy. Fortunately, the advent of advanced Internet of Things (IoT) has made possible more effective and efficient solutions for the congestion issue. Besides, with the availability of the Machine Learning (ML) models, there is hope that the ATC system can be improved with the IoT approach, adopting the ML models. In this paper, we propose a machine learning model for adaptive traffic light control system. First, we assume traffic data is collected from internet-connected IOT sensing devices in vehicles on the roads. Next, the proposed machine learning model receives the data analyzed in cloud, and generates an optimal traffic light period as output. Finally, the optimal traffic light period is transformed to traffic light setting signals to be delivered to the IoT actuating devices in the crossroads. For verifying the proposed model, we build a traffic simulator. For a 24-hour simulated period, the proposed model reduces 55.7{\%} waiting time and 12.76{\%} maximum road occupancy on average, as compared with the Fixed Traffic Light Control System (FTLCS). We also simulate different traffic levels, and our model performs consistently better than the FTLCS in the overall waiting time and maximum road occupancy. The experimental results show that the proposed model is able to alleviate the traffic congestion problem.",
author = "Kao, {Ying Cih} and Wu, {Cheng Wen}",
year = "2019",
month = "2",
day = "19",
doi = "10.1109/ACSSC.2018.8645125",
language = "English",
series = "Conference Record - Asilomar Conference on Signals, Systems and Computers",
publisher = "IEEE Computer Society",
pages = "2060--2064",
editor = "Matthews, {Michael B.}",
booktitle = "Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018",
address = "United States",

}

Kao, YC & Wu, CW 2019, A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning. in MB Matthews (ed.), Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018., 8645125, Conference Record - Asilomar Conference on Signals, Systems and Computers, vol. 2018-October, IEEE Computer Society, pp. 2060-2064, 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018, Pacific Grove, United States, 18-10-28. https://doi.org/10.1109/ACSSC.2018.8645125

A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning. / Kao, Ying Cih; Wu, Cheng Wen.

Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018. ed. / Michael B. Matthews. IEEE Computer Society, 2019. p. 2060-2064 8645125 (Conference Record - Asilomar Conference on Signals, Systems and Computers; Vol. 2018-October).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning

AU - Kao, Ying Cih

AU - Wu, Cheng Wen

PY - 2019/2/19

Y1 - 2019/2/19

N2 - Increasing urban congestion is a common problem in big cities all over the world. Some Adaptive traffic control (ATC) systems have been proposed to reduce the total travel delay time, which is the main factor of congestion cost. However, previous solutions need a great number of sensors and hardware devices, which are hard to deploy. Fortunately, the advent of advanced Internet of Things (IoT) has made possible more effective and efficient solutions for the congestion issue. Besides, with the availability of the Machine Learning (ML) models, there is hope that the ATC system can be improved with the IoT approach, adopting the ML models. In this paper, we propose a machine learning model for adaptive traffic light control system. First, we assume traffic data is collected from internet-connected IOT sensing devices in vehicles on the roads. Next, the proposed machine learning model receives the data analyzed in cloud, and generates an optimal traffic light period as output. Finally, the optimal traffic light period is transformed to traffic light setting signals to be delivered to the IoT actuating devices in the crossroads. For verifying the proposed model, we build a traffic simulator. For a 24-hour simulated period, the proposed model reduces 55.7% waiting time and 12.76% maximum road occupancy on average, as compared with the Fixed Traffic Light Control System (FTLCS). We also simulate different traffic levels, and our model performs consistently better than the FTLCS in the overall waiting time and maximum road occupancy. The experimental results show that the proposed model is able to alleviate the traffic congestion problem.

AB - Increasing urban congestion is a common problem in big cities all over the world. Some Adaptive traffic control (ATC) systems have been proposed to reduce the total travel delay time, which is the main factor of congestion cost. However, previous solutions need a great number of sensors and hardware devices, which are hard to deploy. Fortunately, the advent of advanced Internet of Things (IoT) has made possible more effective and efficient solutions for the congestion issue. Besides, with the availability of the Machine Learning (ML) models, there is hope that the ATC system can be improved with the IoT approach, adopting the ML models. In this paper, we propose a machine learning model for adaptive traffic light control system. First, we assume traffic data is collected from internet-connected IOT sensing devices in vehicles on the roads. Next, the proposed machine learning model receives the data analyzed in cloud, and generates an optimal traffic light period as output. Finally, the optimal traffic light period is transformed to traffic light setting signals to be delivered to the IoT actuating devices in the crossroads. For verifying the proposed model, we build a traffic simulator. For a 24-hour simulated period, the proposed model reduces 55.7% waiting time and 12.76% maximum road occupancy on average, as compared with the Fixed Traffic Light Control System (FTLCS). We also simulate different traffic levels, and our model performs consistently better than the FTLCS in the overall waiting time and maximum road occupancy. The experimental results show that the proposed model is able to alleviate the traffic congestion problem.

UR - http://www.scopus.com/inward/record.url?scp=85062972678&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062972678&partnerID=8YFLogxK

U2 - 10.1109/ACSSC.2018.8645125

DO - 10.1109/ACSSC.2018.8645125

M3 - Conference contribution

AN - SCOPUS:85062972678

T3 - Conference Record - Asilomar Conference on Signals, Systems and Computers

SP - 2060

EP - 2064

BT - Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018

A2 - Matthews, Michael B.

PB - IEEE Computer Society

ER -

Kao YC, Wu CW. A Self-Organizing Map-Based Adaptive Traffic Light Control System with Reinforcement Learning. In Matthews MB, editor, Conference Record of the 52nd Asilomar Conference on Signals, Systems and Computers, ACSSC 2018. IEEE Computer Society. 2019. p. 2060-2064. 8645125. (Conference Record - Asilomar Conference on Signals, Systems and Computers). https://doi.org/10.1109/ACSSC.2018.8645125