A multi-scale feature likelihood map for direct evaluation of object hypotheses

Ivan Laptev and Tony Lindeberg

Technical report CVAP249, ISRN KTH NA/P--01/03--SE. Department of Numerical Analysis and Computer Science, KTH (Royal Institute of Technology), S-100 44 Stockholm, Sweden, March 2001.

Shortened version in IEEE Workshop on Scale-Space and Morphology, Vancouver, Canada, July 2001, M. Kerckhove (Ed.), Volume 2106 of Springer Verlag Lecture Notes in Computer Science, pages 98--110.

Extended version in International Journal of Computer Vision, vol. 52, number 2/3, pages 97--120, 2003.

Abstract

This paper develops and investigates a new approach for evaluating feature based object hypotheses in a direct way. The idea is to compute a feature likelihood map (FLM), which is a function normalized to the interval [0, 1], and which approximates the likelihood of image features at all points in scale-space. In our case, the FLM is defined from Gaussian derivative operators and in such a way that it assumes its strongest responses near the centers of symmetric blob-like or elongated ridge-like structures and at scales that reflect the size of these structures in the image domain. While the FLM inherits several advantages of feature based image representations, it also (i) avoids the need for explicit search when matching features in object models to image data, and (ii) eliminates the need for thresholds present in most traditional feature based approaches. In an application presented in this paper, the FLM is applied to simultaneous tracking and recognition of hand models based particle filtering. The experiments demonstrate the feasibility of the approach, and that real time performance can be obtained by a pyramid implementation of the proposed concept.

Postscript: (600 kb)

PDF: (375 kb)

Extended journal version: (1.5 Mb)

Related publications: (Tracking of multi-state hand models using particle filtering and a hierarchy of multi-scale image features) (Qualitative multi-scale feature hierarchies for object tracking) (Edge detection and ridge detection with automatic scale selection) (Monograph on scale-space theory) (A prototype system for computer vision based human computer interaction)

Related project: Computer vision based human-computer interaction

Ivan Laptev <laptev@nada.kth.se>