Abstract
In this paper, we proposed an UAV system for obstacle avoidance depending of a ground station processing based on monocular vision. To accomplish detection, tracking, proximity estimation and dynamic obstacles avoidance that are approaching the UAV, a series of methods and techniques are implemented. To detect movement, frame differentiation was applied to consecutive frames, once the moving object is detected, we detect Shi-Tomasi feature points to track the object using optical flow method Lucas-Kanade. To make possible proximity estimation, a linear regression method based on the area covered by the object was used. A fuzzy logic controller was designed to avoid the moving object, we considered the approach rate and the area of the object to control UAV’s position in relation to the object as fuzzy inputs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Orbea, D., Moposita, J., Aguilar, W.G., Paredes, M., Reyes, R.P., Montoya, L.: Vertical take off and landing with fixed rotor. In: Chilean Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON), Pucón, Chile (2017)
Orbea, D., Moposita, J., Aguilar, W.G., Paredes, M., León, G., Jara-Olmedo, A.: Math model of UAV multi rotor prototype with fixed wing aerodynamic structure for a flight simulator. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017. LNCS, vol. 10324, pp. 199–211. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60922-5_15
Andrea, C.C., Byron, J.Q., Jorge, P.I., Inti, T.C.H., Aguilar, W.G.: Geolocation and counting of people with aerial thermal imaging for rescue purposes. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10850, pp. 171–182. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95270-3_12
Pardo, J.A., Aguilar, W.G., Toulkeridis, T.: Wireless communication system for the transmission of thermal images from a UAV. In: Chilean Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON), Pucón, Chile (2017)
Jara-Olmedo, A., Medina-Pazmiño, W., Mesías, R., Araujo-Villaroel, B., Aguilar, W.G., Pardo, J.A.: Interface of optimal electro-optical/infrared for unmanned aerial vehicles. In: Rocha, Á., Guarda, T. (eds.) MICRADS 2018. SIST, vol. 94, pp. 372–380. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78605-6_32
Jara-Olmedo, A., Medina-Pazmiño, W., Tozer, T., Aguilar, W.G., Pardo, J.A.: E-services from emergency communication network: aerial platform evaluation. In: International Conference on eDemocracy & eGovernment (ICEDEG) (2018)
Aguilar, W.G., Manosalvas, J.F., Guillén, J.A., Collaguazo, B.: Robust motion estimation based on multiple monocular camera for indoor autonomous navigation of micro aerial vehicle. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10851, pp. 547–561. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95282-6_39
Chen, J.: UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment. Ergonomics 53(8), 940–950 (2010)
Zhang, C., Kovacs, J.M.: The application of small unmanned aerial systems for precision agriculture: a review. Precis. Agric. 13(6), 693–712 (2012)
Zhang, J., Liu, W., Wu, Y.: Novel technique for vision-based UAV navigation. IEEE Trans. Aerosp. Electron. Syst. 47(4), 2731–2741 (2011)
Aguilar, W.G., et al.: Real-time detection and simulation of abnormal crowd behavior. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017. LNCS, vol. 10325, pp. 420–428. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60928-7_36
Aguilar, W.G., et al.: Statistical abnormal crowd behavior detection and simulation for real-time applications. In: Huang, Y., Wu, H., Liu, H., Yin, Z. (eds.) ICIRA 2017. LNCS (LNAI), vol. 10463, pp. 671–682. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65292-4_58
Aguilar, W.G., et al.: Pedestrian detection for UAVs using cascade classifiers and saliency maps. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 563–574. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59147-6_48
Aguilar, W.G., Luna, M., Moya, J., Abad, V., Parra, H., Ruiz, H.: Pedestrian detection for UAVs using cascade classifiers with meanshift. In: IEEE 11th International Conference on Semantic Computing (ICSC), San Diego (2017)
Liu, Z., Zhang, Y., Yu, X., Yuan, C.: Unmanned surface vehicles: an overview of developments and challenges. Annu. Rev. Control 41, 71–93 (2016)
Martínez-Carranza, J., Valentín, L., Márquez-Aquino, F., Gonzáles-Islas, J.C., Loewen, N.: Detección de obstáculos durante vuelo autónomo de drones utilizando SLAM monocular. Res. Comput. Sci. 114, 111–124 (2016)
Aleotti, J., et al.: Detection of nuclear sources by UAV teleoperation using a visuo-haptic augmented reality interface. Sensors 17(10), 1–22 (2017)
Odelga, M., Stegagno, P., Bulthoff, H.H.: Obstacle detection, tracking and avoidance for a teleoperated UAV. In: Proceedings - IEEE International Conference on Robotics and Automation, pp. 2984–2990 (2016)
Aguilar, W.G., Angulo, C., Costa-Castello, R.: Autonomous navigation control for quadrotors in trajectories tracking. In: Huang, Y., Wu, H., Liu, H., Yin, Z. (eds.) ICIRA 2017. LNCS (LNAI), vol. 10464, pp. 287–297. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65298-6_27
Aguilar, W.G., Casaliglla, V.P., Pólit, J.L.: Obstacle avoidance based-visual navigation for micro aerial vehicles. Electronics 6(1), 10 (2017)
Aguilar, W.G., Quisaguano, F.J., Rodríguez, G.A., Alvarez, L.G., Limaico, A., Sandoval, D.S.: Convolutional neuronal networks based monocular object detection and depth perception for micro UAVs. In: Peng, Y., Yu, K., Lu, J., Jiang, X. (eds.) IScIDE 2018. LNCS, vol. 11266, pp. 401–410. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02698-1_35
Aguilar, W.G., Salcedo, V.S., Sandoval, D.S., Cobeña, B.: Developing of a video-based model for UAV autonomous navigation. In: Barone, D.A.C., Teles, E.O., Brackmann, C.P. (eds.) LAWCN 2017. CCIS, vol. 720, pp. 94–105. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-71011-2_8
Salcedo, V.S., Aguilar, W.G., Cobeña, B., Pardo, J.A., Proaño, Z.: On-board target virtualization using image features for UAV autonomous tracking. In: Boudriga, N., Alouini, M.-S., Rekhis, S., Sabir, E., Pollin, S. (eds.) UNet 2018. LNCS, vol. 11277, pp. 384–391. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02849-7_34
Galarza, J., Pérez, E., Serrano, E., Tapia, A., Aguilar, W.G.: Pose estimation based on monocular visual odometry and lane detection for intelligent vehicles. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10851, pp. 562–566. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95282-6_40
Basantes, J., et al.: Capture and processing of geospatial data with laser scanner system for 3D modeling and virtual reality of Amazonian Caves. In: IEEE Ecuador Technical Chapters Meeting (ETCM), Samborondón, Ecuador (2018)
Aguilar, W.G., Rodríguez, G.A., Álvarez, L., Sandoval, S., Quisaguano, F., Limaico, A.: Visual SLAM with a RGB-D camera on a quadrotor UAV using on-board processing. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 596–606. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59147-6_51
Hassaballah, M., Abdelmgeid, A.A., Alshazly, H.A.: Image features detection, description and matching. In: Awad, A.I., Hassaballah, M. (eds.) Image Feature Detectors and Descriptors. SCI, vol. 630, pp. 11–45. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-28854-3_2
Yi, J., Zhang, J.: IMU-based localization and slip estimation for skid-steered mobile robots. In: 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (2007)
Gageik, N., Benz, P., Sergio, M.: Obstacle detection and collision avoidance for a UAV with complementary low-cost sensors. IEEE Access 3, 599–609 (2015)
Aguilar, W.G., Rodríguez, G.A., Álvarez, L., Sandoval, S., Quisaguano, F., Limaico, A.: Real-time 3D modeling with a RGB-D camera and on-board processing. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017. LNCS, vol. 10325, pp. 410–419. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60928-7_35
Aguilar, W.G., Rodríguez, G.A., Álvarez, L., Sandoval, S., Quisaguano, F., Limaico, A.: On-board visual SLAM on a UGV using a RGB-D camera. In: Huang, Y., Wu, H., Liu, H., Yin, Z. (eds.) ICIRA 2017. LNCS (LNAI), vol. 10464, pp. 298–308. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65298-6_28
Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38(4) (2006)
Aguilar, W.G., Cobeña, B., Rodriguez, G., Salcedo, V.S., Collaguazo, B.: SVM and RGB-D sensor based gesture recognition for UAV control. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10851, pp. 713–719. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95282-6_50
Aguilar, W.G., Angulo, C.: Real-time model-based video stabilization for microaerial vehicles. Neural Process. Lett. 43(2), 459–477 (2016)
Aguilar, W.G., Angulo, C.: Real-time video stabilization without phantom movements for micro aerial vehicles. EURASIP J. Image Video Process. 1, 1–13 (2014)
Zingg, S., Scaramuzza, D., Weiss, S., Siegwart, R.: MAV navigation through indoor corridors using optical flow. In: 2010 IEEE International Conference on Robotics and Automation, pp. 3361–3368 (2010)
Vedaldi, A.: An implementation of SIFT detector and descriptor (2006)
Amaguaña, F., Collaguazo, B., Tituaña, J., Aguilar, W.G.: Simulation system based on augmented reality for optimization of training tactics on military operations. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10850, pp. 394–403. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95270-3_33
Aguilar, W.G., Morales, S.: 3D environment mapping using the kinect V2 and path planning based on RRT algorithms. Electronics 5(4), 70 (2016)
Ritcher, C., Bry, A., Roy, N.: Polynomial trajectory planning for aggressive quadrotor flight in dense indoor environments. Robot. Res. 114, 649–666 (2016)
Marr, D., Poggio, T.: A computational theory of human stereo vision. Proc. R. Soc. B Biol. Sci. 204(1156), 301–328 (1979)
Canny, J.: A computational approach to edge detection. In: Reading in Computer Vision, pp. 184–203 (1987)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Aguilar, W.G., Álvarez, L., Grijalva, S., Rojas, I. (2019). Monocular Vision-Based Dynamic Moving Obstacles Detection and Avoidance. In: Yu, H., Liu, J., Liu, L., Ju, Z., Liu, Y., Zhou, D. (eds) Intelligent Robotics and Applications. ICIRA 2019. Lecture Notes in Computer Science(), vol 11744. Springer, Cham. https://doi.org/10.1007/978-3-030-27541-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-27541-9_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27540-2
Online ISBN: 978-3-030-27541-9
eBook Packages: Computer ScienceComputer Science (R0)