Abstract
Given ambitious mission objectives and long delay times between command-uplink/data-downlink sessions, increased autonomy is required for planetary rovers. Specifically, NASA's planned 2003 and 2005 Mars rover missions must incorporate increased autonomy if their desired mission goals are to be realized. Increased autonomy, including autonomous path planning and navigation to user designated goals, relies on good quality estimates of the rover's state, e.g., its position and orientation relative to some initial reference frame. The challenging terrain over which the rover will necessarily traverse tends to seriously degrade a dead-reckoned state estimate, given severe wheel slip and/or interaction with obstacles. In this paper, we present the implementation of a complete rover navigation system. First, the system is able to adaptively construct semi-sparse terrain maps based on the current ground texture and distances to possible nearby obstacles. Second, the rover is able to match successively constructed terrain maps to obtain a vision-based state estimate which can then be fused with wheel odometry to obtain a much improved state estimate. Finally the rover makes use of this state estimate to perform autonomous real-time path planning and navigation to user designated goals. Reactive obstacle avoidance is also implemented for roaming in an environment in the absence of a user designated goal. The system is demonstrated in soft soil and relatively dense rock fields, achieving state estimates that are significantly improved with respect to dead reckoning alone (e.g., 0.38 m mean absolute error vs. 1.34 m), and successfully navigating in multiple trials to user designated goals.
Similar content being viewed by others
References
Barshan, B. and Durrant-Whyte, H. F. 1995. Inertial Navigation Systems for Mobile Robots, IEEE Transactions on Robotics and Automation, Vol. 11,No. 3, pp. 328–342.
Baumgartner, E. T., and Skarr, S. B. 1994. An Autonomous Vision-Based Mobile Robot, IEEE Transactions on Automatic Control, Vol. 39,No. 3, 493–502.
Bernard, S. T., Fischler, M.A. 1982. Computational Stereo, Comput. Surv. 14(4):553–572.
Betge'-Brezetz, S., Chatila, R., Devy, M. 1995. Object-based Modelling and Localization in Natural Environments, IEEE International Conference on Robotics and Automation, pp. 2920–2927.
Connolly, C. I., Burns, J. B., Weiss, R. 1990. Path Planning Using Laplace's Equation, Proc. IEEE International Conference on Robotics and Automation, pp. 2101–2106.
Espinal, F., Huntsberger, T., Jawerth, B., Kubota, T. 1998. Wavelet-Based Fractal Signature Analysis for Automatic Target Recognition, Optical Engineering, Vol. 37,No. 1, pp. 166–174.
Feder, H. J. S., and Slotine, J-J. E. 1997. Real-Time Path Planning Using Harmonic Potentials in Dynamic Environments, IEEE International Conference on Robotics and Automation (ICRA), Vol 1, pp. 874–881.
Fua, P. 1993. A parallel stereo algorithm that produces dense depth maps and preserves image features, Machine Vision and Applications, 6(1).
Gennery, D. B. 1989. Visual terrain matching for a Mars rover, Proc. International Conference on Computer Vision and Pattern Recognition, pp. 483–491, San Diego, CA.
Gennery, D. B. 1993. Least-Squares Camera Calibration Including Lens Distortion and Automatic Editing of Calibration Points, Calibration and Orientation of Cameras in Computer Vision, A. Grün and T. Huang, editors, Springer-Verlag.
Hebert, M., Caillas, C., Krotkov, E., Kweon, I.S., Kanade, T. 1989. Terrain Mapping for a Roving Planetary Explorer, Proc. IEEE International Conference on Robotics and Automation, pp. 997–1002.
Khatib, O. 1986. Real-Time Obstacle Avoidance for Manipulators and Mobile Robotics, The International Journal of Robotics Research, 5,No. 1, pp. 90–98.
Kim, J-O., Khosla, P. 1991. Real-Time Obstacle Avoidance Using Harmonic Potential Functions, IEEE International Conference on Robotics and Automation, vol. 1, pp. 790–796.
Lacroix, S., Fillatreau, P., Nashashibi, F. 1993. Perception for Autonomous Navigation in a Natural Environment, Workshop on Computer Vision for Space Applications, Antibes, France, Sept. 22–24.
Lain, A., and Fan, J. 1993. Texture Classification by Wavelet Packing Signatures, IEEE Trans. PAMI, Vol. 15,No. 11, pp. 1186–1191.
Matthies, L., Gat, E., Harrison, R., Wilcox, B., Volpe, R., Litwin, T. 1995. Mars Microrover Navigation: Performance Evaluation and Enhancement, Autonomous Robots Journal, special issue on Autonomous Vehicles for Planetary Exploration, Vol. 2(4), pp. 291–312.
Matthies, L. 1987. Dynamic Stereo Vision, Ph.D. Thesis, Computer Science Department, Carnegie Mellon.
Matthies, L., Olson, C., Tharp, G., Laubach, S. 1997. Visual Localization Methods for Mars Rovers Using Lander, Rover, and Descent Imageery, International Symposium on Artificial Intelligence, Robotics, and Automation in Space (i-SAIRAS), Tokyo, Japan, pp. 413–418.
Olson, C. 1997. Mobile Robot Self-Localization by Iconic Matching of Range Maps, Proc. of the 8th International Conference on Advanced Robotics, pp. 447–452.
Quinlan, S., Khatib, O. 1993. Elastic Bands: Connecting Path Planning and Control, Proc. IEEE International Conference on Robotics and Automation, 2, pp. 802–808.
Roberts, B. and Bhanu, B. 1992. Inertial Navigation Sensor Integrated Motion Analysis for Autonomous Vehicle Navigation, Journal of Robotic Systems, Special Issue on Passive Ranging For Robotic Systems, Vol. 9,No. 6, pp. 817–842.
Roumeliotis, S., Bekey, G. 1997. An Extended Kalman Filter for frequent local and infrequent global sensor data fusion, Proc. SPIE Vol. 3209, pp. 11–22.
Schenker, P.S., Baumgartner, E.T., Lee, S., Aghazarian, H., Garrett, M.S., Lindemann, R.A., Brown, D.K., Bar-Cohen, Y., Lih, S., Joffe, B., Kim, S.S., Hoffman, B.D., Huntsberger, T. 1997. Dexterous robotic sampling for Mars in-situ science, Intelligent Robotics and Computer Vision XVI, Proc. SPIE 3208, Pittsburgh, PA, Oct 14–17, pp. 170–185.
Stollnitz, E. J., DeRose, T. D., Salesin, D. H. 1996. Wavelets for Computer Graphics, Theory and Applications, Morgan Kaufmann Publishers, Inc., San Francisco, CA.
Walker, M. W., Shao, L. and Volz, R. A. 1991. Estimating 3-D location parameters using dual number quaternions, CVGIP: Image Understanding 54(3), 358–367.
Xiong, Y. and Matthies, L. 1997. Error Analysis of a Real-Time Stereo System, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1087–1093.
Zhang, Z. 1994. Iterative Point Matching for Registration of Free-Form Curves and Surfaces, International Journal of Computer Vision, 13:2, 119–152.
Zhang, Z., Deriche, R., Faugeras, O., Luong, Q-T. 1995. A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry, Artificial Intelligence Journal, Vol. 78, pp. 87–119.
Zhang, Z. 1996. A Stereovision System for a Planetary Rover: Calibration, Correlation, Registration, and Fusion,” Proc. IEEE Workshop on Planetary Rover Technology and Systems, Minneapolis, Minnesota.
Zhang, Z. 1996. On the Epipolar Geometry Between Two Images With Lens Distortion,” Proc. Int'l Conf. Pattern Recognition (ICPR), Vol. I, pp. 407–411, Vienna.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hoffman, B.D., Baumgartner, E.T., Huntsberger, T.L. et al. Improved Rover State Estimation in Challenging Terrain. Autonomous Robots 6, 113–130 (1999). https://doi.org/10.1023/A:1008879310128
Issue Date:
DOI: https://doi.org/10.1023/A:1008879310128