Visual Tracking with Discriminative Correlation Filters

Deformable Parts Correlation Filters for Robust Visual Tracking

Deformable-parts CF

Deformable parts models show a great potential in tracking by principally addressing non-rigid object deformations and self occlusions, but according to recent benchmarks, they often lag behind the holistic approaches. The reason is that potentially large number of degrees of freedom have to be estimated for object localization and simplifications of the constellation topology are often assumed to make the inference tractable. We present a new formulation of the constellation model with correlation filters that treats the geometric and visual constraints within a single convex cost function and derive a highly efficient optimization for MAP inference of a fully-connected constellation. We propose a tracker that models the object at two levels of detail. The coarse level corresponds a root correlation filter and a novel color model for approximate object localization, while the mid-level representation is composed of the new deformable constellation of correlation filters that refine the object location. The resulting tracker is rigorously analyzed on a highly challenging OTB, VOT2014 and VOT2015 benchmarks, exhibits a state-of-the-art performance and runs in real-time.

Paper: TCyB

Discriminative Correlation Filter with Channel and Spatial Reliability

Channel-Spatial-Reliability CF

Short-term tracking is an open and challenging problem for which discriminative correlation filters (DCF) have shown excellent performance. We introduce the channel and spatial reliability concepts to DCF tracking and provide a novel learning algorithm for its efficient and seamless integration in the filter update and the tracking process. The spatial reliability map adjusts the filter support to the part of the object suitable for tracking. This both allows to enlarge the search region and improves tracking of non-rectangular objects. Reliability scores reflect channel-wise quality of the learned filters and are used as feature weighting coefficients in localization. Experimentally, with only two simple standard features, HoGs and Colornames, the novel CSR-DCF method -- DCF with Channel and Spatial Reliability -- achieves state-of-the-art results on VOT 2016, VOT 2015 and OTB100. The CSR-DCF runs in real-time on a CPU.

Papers: CVPR17, IJCV
Source code: Github
C++ version of the tracker is available in OpenCV contrib repository (tracking module) Github

Alan Lukežič, Tomáš Vojíř, Luka Čehovin, Jiří Matas and Matej Kristan.
Discriminative Correlation Filter Tracker with Channel and Spatial Reliability.
International Journal of Computer Vision, 2018.

Alan Lukežič, Tomáš Vojíř, Luka Čehovin, Jiří Matas and Matej Kristan.
Discriminative Correlation Filter with Channel and Spatial Reliability.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.

Demo video on YouTube: