Title
Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection
Abstract
This paper presents a new method to solve the scheduling problem of adaptive traffic signal control at intersection. The method involves recursive least-squares temporal difference (RLS-TD(λ)) learning that is integrated into approximate dynamic programming. The learning mechanism of RLS-TD(λ) is to make an adaptation of linear function approximation by updating its parameters based on environmental feedback. This study investigates the method implementation after modeling a traffic dynamic system at intersection in discrete time. In the model, different traffic control schemes regarding signal phase sequence are considered, especially the defined adaptive phase sequence (APS). By simulating traffic scenarios, RLS-TD(λ) is superior to TD(λ) for updating functional parameters in the approximation, and APS outperforms other conventional control schemes on reducing traffic delay. By comparing with other traffic signal control algorithms, the proposed algorithm yields satisfying results in terms of traffic delay and computation time.
Year
DOI
Venue
2019
10.1007/s00521-017-3066-9
Neural Computing and Applications
Keywords
Field
DocType
Adaptive traffic signal control, Recursive least-squares temporal difference, Approximate dynamic programming, Adaptive phase sequence
Dynamic programming,Mathematical optimization,Temporal difference learning,Job shop scheduling,Computer science,Artificial intelligence,Discrete time and continuous time,Linear function,Machine learning,Recursion,Recursive least squares filter,Computation
Journal
Volume
Issue
ISSN
31.0
SUPnan
1433-3058
Citations 
PageRank 
References 
1
0.35
20
Authors
3
Name
Order
Citations
PageRank
Biao Yin143.12
Mahjoub Dridi2227.05
Abdellah El Moudni315326.13