Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Butterfly Transform: An Efficient FFT Based Neural Architecture Design   In this paper, we show that extending the butterfly operations from the FFT
algorithm to a general Butterfly Transform (BFT) can be beneficial in building
an efficient block structure for CNN designs. Pointwise convolutions, which we
refer to as channel fusions, are the main computational bottleneck in the
state-of-the-art efficient CNNs (e.g. MobileNets ). We introduce a set of
criteria for channel fusion and prove that BFT yields an asymptotically optimal
FLOP count with respect to these criteria. By replacing pointwise convolutions
with BFT, we reduce the computational complexity of these layers from O(n^2) to
O(n\log n) with respect to the number of channels. Our experimental evaluations
show that our method results in significant accuracy gains across a wide range
of network architectures, especially at low FLOP ranges. For example, BFT
results in up to a 6.75% absolute Top-1 improvement for MobileNetV1, 4.4 \% for
ShuffleNet V2 and 5.4% for MobileNetV3 on ImageNet under a similar number of
FLOPS. Notably, ShuffleNet-V2+BFT outperforms state-of-the-art architecture
search methods MNasNet, FBNet and MobilenetV3 in the low FLOP regime.

31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph