Title
Asynchronous Reinforcement Learning Framework and Knowledge Transfer for Net-Order Exploration in Detailed Routing
Abstract
The net orders in detailed routing are crucial to routing closure, especially in most modern routers following the sequential routing manner with the rip-up and reroute scheme. In advanced technology nodes, detailed routing has to deal with complicated design rules and large problem sizes, making its performance more sensitive to the order of nets to be routed. In the literature, the net orders are mostly determined by simple heuristic rules tuned for specific benchmarks. In this work, we propose an asynchronous reinforcement learning (RL) framework to automatically search for optimal ordering strategies and a transfer learning (TL) algorithm to improve performance. By asynchronous querying, the router, pretraining the RL agents, and finetuning with the TL algorithm, we can generate high-performance routing sequences to achieve a 26% reduction in the DRC violations and a 1.2% reduction in the total costs compared with the state-of-the-art detailed router.
Year
DOI
Venue
2022
10.1109/TCAD.2021.3117505
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Keywords
DocType
Volume
Detailed routing,physical design,policy distillation,reinforcement learning (RL),transfer learning (TL)
Journal
41
Issue
ISSN
Citations 
9
0278-0070
0
PageRank 
References 
Authors
0.34
16
5
Name
Order
Citations
PageRank
Yibo Lin100.34
Tong Qu200.68
Zongqing Lu320926.18
Yajuan Su441.44
Yayi Wei541.44