  The Internet of Vehicles (IoV) enables real-time data exchange among vehicles
and roadside units and thus provides a promising solution to alleviate traffic
jams in the urban area. Meanwhile, better traffic management via efficient
traffic light control can benefit the IoV as well by enabling a better
communication environment and decreasing the network load. As such, IoV and
efficient traffic light control can formulate a virtuous cycle. Edge computing,
an emerging technology to provide low-latency computation capabilities at the
edge of the network, can further improve the performance of this cycle.
However, while the collected information is valuable, an efficient solution for
better utilization and faster feedback has yet to be developed for
edge-empowered IoV. To this end, we propose a Decentralized Reinforcement
Learning at the Edge for traffic light control in the IoV (DRLE). DRLE exploits
the ubiquity of the IoV to accelerate the collection of traffic data and its
interpretation towards alleviating congestion and providing better traffic
light control. DRLE operates within the coverage of the edge servers and uses
aggregated data from neighboring edge servers to provide city-scale traffic
light control. DRLE decomposes the highly complex problem of large area
control. into a decentralized multi-agent problem. We prove its global optima
with concrete mathematical reasoning. The proposed decentralized reinforcement
learning algorithm running at each edge node adapts the traffic lights in real
time. We conduct extensive evaluations and demonstrate the superiority of this
approach over several state-of-the-art algorithms.
