  Determining the extrinsic parameter between multiple LiDARs and cameras is
essential for autonomous robots, especially for solid-state LiDARs, where each
LiDAR unit has a very small Field-of-View (FoV), and multiple units are often
used collectively. The majority of extrinsic calibration methods are proposed
for 360$^\circ$ mechanical spinning LiDARs where the FoV overlap with other
LiDAR or camera sensors is assumed. Few research works have been focused on the
calibration of small FoV LiDARs and cameras nor on the improvement of the
calibration speed. In this work, we consider the problem of extrinsic
calibration among small FoV LiDARs and cameras, with the aim to shorten the
total calibration time and further improve the calibration precision. We first
implement an adaptive voxelization technique in the extraction and matching of
LiDAR feature points. Such a process could avoid the redundant creation of
$k$-d trees in LiDAR extrinsic calibration and extract LiDAR feature points in
a more reliable and fast manner than existing methods. We then formulate the
multiple LiDAR extrinsic calibration into a LiDAR Bundle Adjustment (BA)
problem. By deriving the cost function up to second-order, the solving time and
precision of the non-linear least square problem are further boosted. Our
proposed method has been verified on data collected in four targetless scenes
and under two types of solid-state LiDARs with a completely different scanning
pattern, density, and FoV. The robustness of our work has also been validated
under eight initial setups, with each setup containing 100 independent trials.
Compared with the state-of-the-art methods, our work has increased the
calibration speed 15 times for LiDAR-LiDAR extrinsic calibration and 1.5 times
for LiDAR-Camera extrinsic calibration (averaged result from 50 independent
trials) while remaining accurate.
