Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: BRECQ: Pushing the Limit of Post-Training Quantization by Block
  Reconstruction   We study the challenging task of neural network quantization without
end-to-end retraining, called Post-training Quantization (PTQ). PTQ usually
requires a small subset of training data but produces less powerful quantized
models than Quantization-Aware Training (QAT). In this work, we propose a novel
PTQ framework, dubbed BRECQ, which pushes the limits of bitwidth in PTQ down to
INT2 for the first time. BRECQ leverages the basic building blocks in neural
networks and reconstructs them one-by-one. In a comprehensive theoretical study
of the second-order error, we show that BRECQ achieves a good balance between
cross-layer dependency and generalization error. To further employ the power of
quantization, the mixed precision technique is incorporated in our framework by
approximating the inter-layer and intra-layer sensitivity. Extensive
experiments on various handcrafted and searched neural architectures are
conducted for both image classification and object detection tasks. And for the
first time we prove that, without bells and whistles, PTQ can attain 4-bit
ResNet and MobileNetV2 comparable with QAT and enjoy 240 times faster
production of quantized models. Codes are available at
https://github.com/yhhhli/BRECQ.

33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph