Abstract
This paper presents a novel approach to detect and track pedestrians and cars based on the combined information retrieved from a camera and a laser range scanner. Laser data points are classified using boosted Conditional Random Fields (CRF), while the image based detector uses an extension of the Implicit Shape Model (ISM), which learns a codebook of local descriptors from a set of handlabeled images and uses them to vote for centers of detected objects. Our extensions to ISM include the learning of object sub-parts and template masks to obtain more distinctive votes for the particular object classes. The detections from both sensors are then fused and the objects are tracked using an Extended Kalman Filter with multiple motion models. Experiments conducted in real-world urban scenarios demonstrate the usefulness of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arras, K.O., Mozos, Ó.M., Burgard, W.: Using boosted features for the detection of people in 2d range data. In: IEEE Int. Conf. on Rob. and Autom, ICRA (2007)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. on Pattern Analysis & Machine Intelligence 24(4), 509–522 (2002)
Borgefors, G.: Hierarchical chamfer matching: A parametric edge matching algorithm. IEEE Trans. on Pattern Analysis & Machine Intelligence 10(6), 849–865 (1988)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Conf. on Comp. Vis. and Pat. Recog., CVPR (2005)
Douillard, B., Fox, D., Ramos, F.: Laser and vision based outdoor object mapping. In: Robotics: Science and Systems (RSS), Zurich, Switzerland (June 2008)
Felzenszwalb, P., Huttenlocher, D.: Efficient matching of pictorial structures. In: IEEE Conf. on Comp. Vis. and Pat. Recog (CVPR), pp. 66–73 (2000)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)
Gavrila, D., Philomin, V.: Real-time object detection for “smart“ vehicles. In: IEEE Int. Conf. on Computer Vision, ICCV (1999)
Gavrila, D.M.: The visual analysis of human movement: A survey. Comp. Vis. and Image Und (CVIU) 73(1), 82–98 (1999)
Hähnel, D., Triebel, R., Burgard, W., Thrun, S.: Map building with mobile robots in dynamic environments. In: IEEE Int. Conf. on Rob. and Autom, ICRA (2003)
Ioffe, S., Forsyth, D.A.: Probabilistic methods for finding people. Int. Journ. of Comp. Vis. 43(1), 45–68 (2001)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmentation and labeling sequence data. In: Int. Conf. on Machine Learning, ICML (2001)
Leibe, B., Cornelis, N., Cornelis, K., Gool, L.V.: Dynamic 3d scene analysis from a moving vehicle. In: IEEE Conf. on Comp. Vis. and Pat. Recog, CVPR (2007)
Liu, D., Nocedal, J.: On the limited memory bfgs method for large scale optimization. Math. Programming 45(3, (Ser. B)) (1989)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. on Pattern Analysis & Machine Intelligence 27(10), 1615–1630 (2005)
Premebida, C., Monteiro, G., Nunes, U., Peixoto, P.: A lidar and vision-based approach for pedestrian and vehicle detection and tracking. In: ITSC (2007)
Ramos, F., Fox, D., Durrant-Whyte, H.: CRF-matching: Conditional random fields for feature-based scan matching. In: Robotics: Science and Systems, RSS (2007)
Schulz, D.: A probabilistic exemplar approach to combine laser and vision for person tracking. In: Robotics: Science and Systems, RSS (2006)
Schulz, D., Burgard, W., Fox, D., Cremers, A.: People tracking with mobile robots using sample-based joint probabilistic data ass. filters. Int. Journ. of Rob. Res (IJRR) 22(2) (2003)
Spinello, L., Siegwart, R.: Human detection using multimodal and multidimensional features. In: IEEE Int. Conf. on Rob. and Autom, ICRA (2008)
Spinello, L., Triebel, R., Siegwart, R.: Multimodal detection and tracking of pedestrians in urban environments with explicit ground plane extraction. In: IEEE Int. Conf. on Intell. Rob. and Systems, IROS (2008)
Spinello, L., Triebel, R., Siegwart, R.: Multimodal people detection and tracking in crowded scenes. In: Proc. of the AAAI Conf. on Artificial Intelligence (July 2008)
Topp, E.A., Christensen, H.I.: Tracking for following and passing persons. In: IEEE Int. Conf. on Intell. Rob. and Systems, IROS (2005)
Xavier, J., Pacheco, M., Castro, D., Ruano, A., Nunes, U.: Fast line, arc/circle and leg detection from laser scan data in a player driver. In: IEEE Int. Conf. on Rob. and Autom, ICRA (2005)
Zivkovic, Z., Kröse, B.: Part based people detection using 2d range data and images. In: IEEE Int. Conf. on Intell. Rob. and Systems (IROS), San Diego, USA (November 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Spinello, L., Triebel, R., Siegwart, R. (2010). Multiclass Multimodal Detection and Tracking in Urban Environments ⋆ . In: Howard, A., Iagnemma, K., Kelly, A. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 62. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13408-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-13408-1_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13407-4
Online ISBN: 978-3-642-13408-1
eBook Packages: EngineeringEngineering (R0)