Skip to main content

Traffic Observation and Situation Assessment

  • Conference paper
Outdoor and Large-Scale Real-World Scene Analysis

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7474))

Abstract

Utilization of camera systems for surveillance tasks (e. g. traffic monitoring) has become a standard procedure and has been in use for over 20 years. However, most of the cameras are operated locally and data analyzed manually. Locally means here a limited field of view and that the image sequences are processed independently from other cameras. For the enlargement of the observation area and to avoid occlusions and non-accessible areas multiple camera systems with overlapping and non-overlapping cameras are used. The joint processing of image sequences of a multi-camera system is a scientific and technical challenge. The processing is divided traditionally into camera calibration, object detection, tracking and interpretation. The fusion of information from different cameras is carried out in the world coordinate system. To reduce the network load, a distributed processing concept can be implemented.

Object detection and tracking are fundamental image processing tasks for scene evaluation. Situation assessments are based mainly on characteristic local movement patterns (e.g. directions and speed), from which trajectories are derived. It is possible to recognize atypical movement patterns of each detected object by comparing local properties of the trajectories. Interaction of different objects can also be predicted with an additional classification algorithm.

This presentation discusses trajectory based recognition algorithms for atypical event detection in multi object scenes to obtain area based types of information (e.g. maps of speed patterns, trajectory curvatures or erratic movements) and shows that two-dimensional areal data analysis of moving objects with multiple cameras offers new possibilities for situational analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abdel-Aziz, Y.I.: Photogrammetric Potential of Non Metric Cameras. PhD thesis, University of Illinois, Photogrammetric potential of non metric cameras (1974)

    Google Scholar 

  2. Abdel-Aziz, Y.I., Karara, H.M.: Direct linear transformation into object space coordinates in close-range photogrammetry. In: Symposium on CloseRange Photogrammetry, Urbana, Illinois, pp. 1–18 (1971)

    Google Scholar 

  3. Aköz, Ö., Elif Karsligil, M.: Video-based traffic accident analysis at intersection using partial vehicle trajectories. In: Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR 2010, p. 335 (2010)

    Google Scholar 

  4. Anderson, B., Moor, J.: Optimal filtering. Prentice-Hall, Inc., Enlewood Cliffs (1979)

    MATH  Google Scholar 

  5. Basu, A., Licardie, S.: Alternative models for fish-eye lenses. Pattern Recognition 16(4), 433–441 (1995)

    Article  Google Scholar 

  6. Blackman, S.S.: Multiple-target tracking with radar applications. Artech House, MA (1986)

    Google Scholar 

  7. Brown, D.C.: Close range camera calibration. Photogrammetric Engineering 37(8), 855–866 (1971)

    Google Scholar 

  8. Brown, D.C.: An advanced plate reduction for photogrammetric cameras. Technical report, Air Force Cambridge Research Laboratories (1964)

    Google Scholar 

  9. Brown, D.C.: Decentering distortion of lenses. Photogrammetric Engineering 32(7), 444–462 (1965)

    Google Scholar 

  10. Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)

    Article  Google Scholar 

  11. Chiu, W.-Y., Tsai, D.-M.: A Macro-Observation Scheme for Abnormal Event Detection in Daily-Life Video Sequences. EURASIP Journal on Advances in Signal Processing 2010, 1–20 (2010)

    Article  Google Scholar 

  12. Claus, D., Fitzgibbon, A.W.: A rational function lens distortion model for general cameras. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 213–219 (June 2005)

    Google Scholar 

  13. El-Hakim, S.F.: Real-time image meteorology with ccd cameras. Photogrammetric Engineering and Remote Sensing 52(11), 1757–1766 (1986)

    Google Scholar 

  14. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  15. Forbes, A.B.: Least-squares best fit geometric elements. Technical report, National Physical Laboratory of Great Britain, NPL-report, DITC 140/89 (1989)

    Google Scholar 

  16. Fraser, C.S., Edmundson, K.L.: Design and implementation of a computational processing system for off-line digital close-range photogrammetry. ISPRS Journal of Photogrammetry and Remote Sensing 55(2), 94–104 (2000), doi:10.1016/S0924-2716(00)00010-1

    Article  Google Scholar 

  17. Gennery, D.B.: Generalized camera calibration including fish-eye lenses. International Journal of Computer Vision 68, 239–266 (2002)

    Article  Google Scholar 

  18. Heideklang, R.: Emplyoing a support vector machine to detect hazardous traffic situations, Student’s thesis, Humboldt-Universität zu Berlin (2011)

    Google Scholar 

  19. Heikkil, J.: A polynomial camera model and calibration method for conventional, wide-angle, and fish-eye lenses. IEEE Trans. Pattern Anal. Mach. Intell. 28(8), 1335–1340 (2006)

    Article  Google Scholar 

  20. Javed, O., Shafique, K., Shah, M.: A hierarchical approach to robust background subtraction using color and gradient information. In: IEEE Workshop on Motion and Video Computing, p. 22 (2002)

    Google Scholar 

  21. Jiang, F., Wu, Y., Katsaggelos, A.K.: Abnormal Event Detection from Surveillance Video by Dynamic Hierarchical Clustering. In: 2007 IEEE International Conference on Image Processing, pp. 1:V – 145–V – 148 (2007)

    Google Scholar 

  22. Jiang, S., Ye, Q., Gao, W., Huang, T.: A new method to segment playfield and its applications in match analysis in sports video. In: MULTIMEDIA 2004: Proceedings of the 12th Annual ACM International Conference on Multimedia, pp. 292–295. ACM Press, New York (2004)

    Chapter  Google Scholar 

  23. Kannala, J., Brandt, S.S.: A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses. IEEE Tranactions. Pattern Analysis and Machine Intelligence 28, 1335–1340 (2006)

    Article  Google Scholar 

  24. Kraus, K.: Photogrammetrie 1, 7th edn. Gruyter Verlag (2004) ISBN-10: 3110177080, ISBN-13: 978-3110177084

    Google Scholar 

  25. Leykin, A., Tuceryan, M.: A vision system for automated customer tracking for marketing analysis: Low level feature extraction. In: International Workshop on Human Activity Recognition and Modeling, pp. 1–7 (2005)

    Google Scholar 

  26. Liscano, R., Green, D.: Design and implementation of a trajectory generator for an indoor mobile robot. In: Proceedings of the IEEE/RJS International Conference on Intelligent Robots and Systems. Tsukuba, Japan, pp. 380–385 (1989)

    Google Scholar 

  27. Luhmann, T., Robson, S., Kyle, S., Harley, I.: Close-Range Photogrammetry. Whittles Publishing (2006)

    Google Scholar 

  28. Ma, Y., Soatto, S., Košecká, J., Shankar Sastry, S.: An Invitation to 3-D Vision. Springer (2004)

    Google Scholar 

  29. Maggio, E., Cavallaro, A.: Video Tracking: Theory and Practice. John Wiley & Sons (2011)

    Google Scholar 

  30. Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing 22(10), 761–767 (2004); British Machine Vision Computing 2002

    Article  Google Scholar 

  31. McFarlane, N.J.B., Schofield, C.P.: Segmentation and tracking of piglets in images. Machine Vision and Applications 8(3), 187–193 (1995)

    Article  Google Scholar 

  32. Nelson, W.L.: Continuous steering-function control of robot carts. IEEE Transactions on Industrial Electronics 36(3), 330–337 (1989)

    Article  Google Scholar 

  33. Orekhov, V., Abidi, B., Broaddus, C., Abidi, M.: Universal camera calibration with automatic distortion model selection. In: IEEE International Conference on Image Processing, vol. 6, pp. 397–400 (2007)

    Google Scholar 

  34. Pfeiffer, D., Reulke, R.: Trajectory-based scene description and classification. In: Stilla, U., Rottensteiner, F., Paparoditis, N. (eds.) Object Extraction for 3D City Models, Road Databases and Traffic Monitoring. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science, vol. 38, pp. 41–46 (2009)

    Google Scholar 

  35. Piciarelli, C., Foresti, G.: On-line trajectory clustering for anomalous events detection. Pattern Recognition Letters 27(15), 1835–1842 (2006)

    Article  Google Scholar 

  36. Prati, A., Mikic, I., Grana, C., Trivedi, M.M.: Shadow detection algorithms for traffic flow analysis: a comparative study. In: Proc. IEEE Intelligent Transportation Systems Conf., pp. 340–345 (2001)

    Google Scholar 

  37. Reulke, R., Bauer, S., Döring, T., Meysel, F.: Traffic surveillance using multi-camera detection and multi-target tracking. In: Cree, M. (ed.) Image and Vision Computing New Zealand 2007. University of Waikato, New Zealand (December 2007)

    Google Scholar 

  38. Reulke, R., Meysel, F., Bauer, S.: Situation Analysis and Atypical Event Detection with Multiple Cameras and Multi-Object Tracking. In: Sommer, G., Klette, R. (eds.) RobVis 2008. LNCS, vol. 4931, pp. 234–247. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  39. Reulke, R., Bauer, S., Spangenberg, R.: Multi-camera detection and multi-target tracking. To be published in VISAPP - 3rd International Conference on Computer Vision Theory and Applications (2008)

    Google Scholar 

  40. Reulke, R., Meffert, B., Piltz, B., Bauer, S., Hein, D., Hohloch, M., Kozempel, K.: Long-term investigations of quality and reliability of the video image detection system m3. In: International Workshop on Traffic Data Collection and its Standardization (2008)

    Google Scholar 

  41. Rueß, D., Manthey, K., Reulke, R.: An accurate 3d feature tracking system with wide-baseline stereo smart cameras. In: 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6 (August 2011)

    Google Scholar 

  42. Rueß, D., Reulke, R.: Ellipse Constraints for Improved Wide-Baseline Feature Matching and Reconstruction. In: Aggarwal, J.K., Barneva, R.P., Brimkov, V.E., Koroutchev, K.N., Korutcheva, E.R. (eds.) IWACA 2011. LNCS, vol. 6636, pp. 168–181. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  43. Schneider, D., Schwalbe, E., Maas, H.-G.: Validation of geometric models for fisheye lenses. ISPRS Journal of Photogrammetry and Remote Sensing 64(3), 259–266 (2009)

    Article  Google Scholar 

  44. Sillito, R.R., Fisher, R.B.: Semi-supervised Learning for Anomalous Trajectory Detection. In: BMVC, vol. 27, pp. 1025–1044 (October 2008)

    Google Scholar 

  45. Treutner, N., Hellwig, S., Rueß, D.: A framework for people tracking and situation evaluation in multi-camera outdoor environments. In: Paul, L., Stanke, G., Pochanke, M. (eds.) 3D-Nordost, GFaI (2011)

    Google Scholar 

  46. Yao, B., Wang, L., Zhu, S.-C.: Learning a Scene Contextual Model for Tracking and Abnormality Detection. In: 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–8 (June 2008)

    Google Scholar 

  47. Zhang, Z.: A flexible new technique for camera calibraion. Technical report, Microsoft Research, A Flexible New Technique For Camera Calibraion (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Reulke, R., Rueß, D., Manthey, K., Luber, A. (2012). Traffic Observation and Situation Assessment. In: Dellaert, F., Frahm, JM., Pollefeys, M., Leal-Taixé, L., Rosenhahn, B. (eds) Outdoor and Large-Scale Real-World Scene Analysis. Lecture Notes in Computer Science, vol 7474. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34091-8_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34091-8_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34090-1

  • Online ISBN: 978-3-642-34091-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics