text: In this paper, we propose a simple way to utilize stereo camera data to improve feature descriptors. Computer vision algorithms that use a stereo camera require some calculations of 3D information. We leverage this pre-calculated information to improve feature descriptor algorithms. We use the 3D feature information to estimate the scale of each feature. This way, each feature descriptor will be more robust to scale change without significant computations. In addition, we use stereo images to construct the descriptor vector. The SIFT and FREAK descriptors are used to evaluate the proposed method. The scale normalization technique in feature tracking test improves the standard SIFT by 8.75 and improves the standard FREAK by 28.65 . We also use a simple visual odometry algorithm and test it on the KITTI datasets. The stereo FREAK descriptor raises the number of inlier matches by 19 and consequently improves the accuracy of visual odometry by 23 .
  @cite_15: Deep learning has revolutionalized image-level tasks such as classification, but patch-level tasks, such as correspondence, still rely on hand-crafted features, e.g. SIFT. In this paper we use Convolutional Neural Networks (CNNs) to learn discriminant patch representations and in particular train a Siamese network with pairs of (non-)corresponding patches. We deal with the large number of potential pairs with the combination of a stochastic sampling of the training set and an aggressive mining strategy biased towards patches that are hard to classify. By using the L2 distance during both training and testing we develop 128-D descriptors whose euclidean distances reflect patch similarity, and which can be used as a drop-in replacement for any task involving SIFT. We demonstrate consistent performance gains over the state of the art, and generalize well against scaling and rotation, perspective transformation, non-rigid deformation, and illumination changes. Our descriptors are efficient to compute and amenable to modern GPUs, and are publicly available.
  @cite_4: We investigate if a deep Convolutional Neural Network can learn representations of local image patches that are usable in the important task of keypoint matching. We examine several possible loss functions for this correspondance task and show emprically that a newly suggested loss formulation allows a Convolutional Neural Network to find compact local image descriptors that perform comparably to state-of-the-art approaches.
  @cite_17: 
summary: There are some approaches to construct the descriptor vector by learning a convolutional neural network such as @cite_17 , @cite_4 , and @cite_15 . Most of these works tried to train a convolutional neural network works to extract the features of an input patch using an enormous amount of training patches. Then use these features as a descriptor. These descriptors are similar to the SIFT-like descriptors and The Euclidean distance reflects the features similarity. As a result, feature matching is more time-consuming than the binary descriptors.