An Integrated Traffic and Pedestrian Model-Based Vision System

An Integrated Traffic and Pedestrian Model-Based Vision System

P.M. Remagnino , A. Baumberg, T. Grove , D. Hogg, T.N.Tan, A.D.Worrall, K.D.Baker

Department of Computer Science

The University of Reading


The paper describes a novel integrated vision system in which two autonomous visual modules are combined to interpret a dynamic scene. The first module employs a 3D model-based scheme to track rigid objects such as vehicles. The second module uses a 2D deformable model to track non-rigid objects such as people. The principal contribution is a novel method for handling occlusion between objects within the context of this hybrid tracking system. The practical aim of the work is to derive a scene description that is sufficiently rich to be used in a range of surveillance tasks. The paper describes each of the modules in outline before detailing the method of integration and the handling of occlusion in particular. Experimental results are presented to illustrate the performance of the system in a dynamic outdoor scene involving cars and people.

gzipped Postscript