Title
Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection
Abstract
Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet pretraining is always required for detectors. Training from scratch, as a substitute, demands more epochs to converge and brings no computation saving. To overcome this obstacle, we introduce a practical neural architecture transformation search(NATS) algorithm for object detection in this paper. Instead of searching and constructing an entire network, NATS explores the architecture space on the base of existing network and reusing its weights. We propose a novel neural architecture search strategy in channel-level instead of path-level and devise a search space specially targeting at object detection. With the combination of these two designs, an architecture transformation scheme could be discovered to adapt a network designed for image classification to task of object detection. Since our method is gradient-based and only searches for a transformation scheme, the weights of models pretrained in ImageNet could be utilized in both searching and retraining stage, which makes the whole process very efficient. The transformed network requires no extra parameters and FLOPs, and is friendly to hardware optimization, which is practical to use in real-time application. In experiments, we demonstrate the effectiveness of NATS on networks like ResNet and ResNeXt. Our transformed networks, combined with various detection frameworks, achieve significant improvements on the COCO dataset while keeping fast.
Year
Venue
Keywords
2019
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019)
image classification,object detection,architecture space
Field
DocType
Volume
Object detection,Architecture,Computer science,Communication channel,Artificial intelligence,Computer engineering,Machine learning
Conference
32
ISSN
Citations 
PageRank 
1049-5258
1
0.35
References 
Authors
0
5
Name
Order
Citations
PageRank
Junran Peng182.52
Ming Sun29116.25
Zhaoxiang Zhang3102299.76
Tieniu Tan411681744.35
Junjie Yan5128858.19