Reviews

A review of achievements in small quadrotor autonomous flight control based on visual servoing

  • LÜ Qiang, MA Jianye, WANG Guosheng, LIN Huican, LIANG Bing
Expand
  • 1. Department of Control Engineering, Academy of Armored Forces Engineering, Beijing 100072, China;
    2. School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou 341000, China

Received date: 2015-12-26

  Revised date: 2016-11-03

  Online published: 2017-02-07

Abstract

In the absence of GPS signal, visual servoing can make use of visual information to control quadrotor autonomous flight, so it has been widely used in the field of autonomous flight control in recent years. This article reviews the achievements of small quadrotor autonomous flight control based on visual servoing. Depending on the difference of image information, visual servoing can be divided into position-based visual servoing and image-based visual servoing. Compared with image-based visual servoing, pose estimation of positionbased visual servoing is stabile, and position-based visual servoing can define the robot movement in the rectangular coordinate space, and the controller design of position-based visual servoing is simple. But the control precision of position-based visual servoing is affected by camera and robot calibration precision, and calculation is large. It is pointed out that for further application of small quadrotor UAV autonomous flight control, the real-time accuracy and robustness of visual servoing need to be improved, and the intelligence of small quadrotor UAV requires upgrading. Also the research should be strengthened in aspects such as indoor/outdoor mode conversion and indoor coordinate control.

Cite this article

LÜ Qiang, MA Jianye, WANG Guosheng, LIN Huican, LIANG Bing . A review of achievements in small quadrotor autonomous flight control based on visual servoing[J]. Science & Technology Review, 2016 , 34(24) : 68 -73 . DOI: 10.3981/j.issn.1000-7857.2016.24.009

References

[1] Doherty P, Rudol P. A UAV search and rescue scenario with human body detection and geolocalization[C]//Proceedings of the 20th Austra-lian Joint Conference on Advances in Artificial Intelligence. Berlin:Springer-Verlag, 2007:1-13.
[2] Goodrich M A, Morse B S, Gerhardt D, et al. Supporting wilderness search and rescue using a camera-equipped mini UAV[J]. Journal of Field Robotics, 2008, 25(1-2):89-110.
[3] Jensen A M, Baumann M, Chen Y Q. Low-cost multispectral aerial im-aging using autonomous runway-free small flying wing vehicles[C]//Geo-science and Remote Sensing Symposium. New York, USA:Institute of Electrical and Electronic Engineers, 2008:506-509.
[4] Rango A, Laliberte A, Herrick J E, et al. Unmanned aerial vehiclebased remote sensing for rangeland assessment, monitoring, and man-agement[J]. Journal of Applied Remote Sensing, 2009, 3(1):9-25.
[5] Rodriguez P A, Geckle W J, Barton J D, et al. An emergency response UAV surveillance system[C]//AMIA Annual Symposium Proceedings, Philadelphia, USA:American Medical Informatics Association, 2006:1078.
[6] Li Z, Liu Y, Walker R, et al. Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform[J]. Machine Vision and Applications, 2010, 21(5):677-686.
[7] Zhang C, Kovacs J M. The application of small unmanned aerial sys-tems for precision agriculture:A review[J]. Precision Agriculture, 2012, 13(6):693-712.
[8] Zenk S N, Schulz A J, Matthews S A, et al. Activity space environment and dietary and physical activity behaviors:a pilot study[J]. Health & Place, 2011, 17(5):1150-1161.
[9] Hightower J, Borriello G. Location systems for ubiquitous computing[J]. Computer, 2001(8):57-66.
[10] Sharp C S, Shakernia O, Sastry S S. A vision system for landing an un-manned aerial vehicle[C]//International Conference on Robotics and Automation (ICRA). New York, USA:Institute of Electrical and Elec-tronic Engineers, 2001:1720-1727.
[11] Meier L, Tanskanen P, Heng L, et al. Pixhawk:A micro aerial vehicle design for autonomous flight using onboard computer vision[J]. Autono-mous Robots, 2012, 33(1-2):21-39.
[12] Davison A J, Reid I D, Molton N D, et al. MonoSLAM:Real-time sin-gle camera SLAM[J]. Pattern Analysis and Machine Intelligence, 2007, 29(6):1052-1067.
[13] Tsalatsanis A, Valavanis K, Yalcin A. Vision based target tracking and collision avoidance for mobile robots[J]. Journal of Intelligent & Robotic Systems, 2007, 48(2):285-304.
[14] Green W E, Oh P Y. Optic-flow-based collision avoidance[J]. Robot-ics & Automation Magazine, 2008, 15(1):96-103.
[15] Caballero F, Merino L, Ferruz J, et al. Vision-based odometry and SLAM for medium and high altitude flying UAVs[J]. Journal of Intelli-gent and Robotic Systems, 2009, 54(1-3):137-161.
[16] Chaumette F, Hutchinson S. Visual servo control. I. basic approaches[J]. Robotics & Automation Magazine, 2006, 13(4):82-90.
[17] Li W, Zhang T, Kühnlenz K. A vision-guided autonomous quadrotor in an air-ground multi-robot system[C]//International Conference on Robotics and Automation (ICRA). New York, USA:Institute of Electri-cal and Electronic Engineers, 2011:2980-2985.
[18] Carrillo L R G, Rondon E, Sanchez A, et al. Stabilization and trajecto-ry tracking of a quad-rotor using vision[J]. Journal of Intelligent & Ro-botic Systems, 2011, 61(1-4):103-118.
[19] Romero H, Salazar S, Lozano R. Visual servoing applied to real-time stabilization of a multi-rotor UAV[J]. Robotica, 2012, 30(4):1-10.
[20] Scaramuzza D, Fraundorfer F. Visual odometry[tutorial][J]. Robotics & Automation Magazine, 2011, 18(4):80-92.
[21] Fraundorfer F, Scaramuzza D. Visual odometry:part II:matching, ro-bustness, optimization, and applications[J]. Robotics & Automation Magazine, 2012, 19(2):78-90.
[22] Durrant-Whyte H, Bailey T. Simultaneous localization and mapping:Part I[J]. Robotics & Automation Magazine, 2006, 13(2):99-110.
[23] Bailey T, Durrant-Whyte H. Simultaneous localization and mapping (SLAM):Part II[J]. Robotics & Automation Magazine, 2006, 13(3):108-117.
[24] Blösch M, Weiss S, Scaramuzza D, et al. Vision based MAV naviga-tion in unknown and unstructured environments[C]//International Con-ference on Robotics and Automation (ICRA). New York, USA:Insti-tute of Electrical and Electronic Engineers, 2010:21-28.
[25] Achtelik M, Achtelik M, Weiss S, et al. Onboard IMU and monocular vision based control for MAVs in unknown in-and outdoor environ-ments[C]//International Conference on Robotics and Automation (ICRA). New York, USA:Institute of Electrical and Electronic Engi-neers, 2011:3056-3063.
[26] Quigley M, Conley K, Gerkey B, et al. ROS:an open-source robot op-erating system[C]. ICRA workshop on open source software, Kobe, Ja-pan, May 12-17, 2009.
[27] Park J, Im S, Lee K H, et al. Vision-based SLAM system for small UAVs in GPS-denied environments[J]. Journal of Aerospace Engineer-ing, 2011, 25(4):519-529.
[28] Faessler M, Fontana F, Forster C, et al. Autonomous, vision-based flight and live dense 3D mapping with a quadrotor micro aerial vehicle[J]. Journal of Field Robotics, 2015, 33(4):431-450.
[29] Huang R, Tan P, Chen B M. Monocular vision-based autonomous navi-gation system on a toy quadcopter in unknown environments[C]//2015 International Conference on Unmanned Aircraft Systems (ICUAS). New York, USA:Institute of Electrical and Electronic Engineers, 2015:1260-1269.
[30] Czupryński B, Strupczewski A. Real-time RGBD SLAM system[C]. Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments, Wilga, Poland, May 25, 2015.
[31] Engel J, Schöps T, Cremers D. LSD-SLAM:Large-scale direct monoc-ular SLAM[C]//Computer Vision-ECCV 2014. Berlin Heidelberg:Springer International Publishing, 2014:834-849.
[32] Mur-Artal R, Montiel J M M, Tardós J D. ORB-SLAM:A versatile and accurate monocular slam system[J]. IEEE Transactions on Robot-ics, 2015, 31(5):1147-1163.
[33] Bills C, Chen J, Saxena A. Autonomous MAV flight in indoor environ-ments using single image perspective cues[C]//International Confer-ence on Robotics and Automation (ICRA). New York, USA:Institute of Electrical and Electronic Engineers, 2011:5776-5783.
[34] De Plinval H, Morin P, Mouyon P, et al. Visual servoing for underactu-ated VTOL UAVs:A linear, homography-based approach[C]//Interna-tional Conference on Robotics and Automation (ICRA). New York, USA:Institute of Electrical and Electronic Engineers, 2011:3004-3010.
[35] Lee D, Ryan T, Kim H J. Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing[C]//International Conference on Robotics and Automation (ICRA). New York, USA:In-stitute of Electrical and Electronic Engineers, 2012:971-976.
[36] Podhradsky M. Visual servoing for a quadcopter flight control[D]. Prague:Czech Technical University, 2012.
[37] Lippiello V, Mebarki R, Ruggiero F. Visual coordinated landing of a UAV on a mobile robot manipulator[C]//International Symposium on Safety, Security, and Rescue Robotics (SSRR). New York, USA:Insti-tute of Electrical and Electronic Engineers, 2013:1-7.
[38] Singh G, Anvar A. Investigating feasibility of target detection by visu-al servoing using UAV for oceanic applications[C]//201413th Interna-tional Conference on Control Automation Robotics & Vision (ICAR-CV). New York, USA:Institute of Electrical and Electronic Engineers, 2014:1621-1626.
[39] Sa I, Hrabar S, Corke P. Inspection of pole-like structures using a vi-sion-controlled VTOL UAV and shared autonomy[C]//2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014). New York, USA:Institute of Electrical and Electronic Engi-neers, 2014:4819-4826.
[40] Araar O, Aouf N. Visual servoing of a quadrotor UAV for the tracking of linear structured infrastructures[C]//International Conference on Sys-tems, Man, and Cybernetics (SMC). New York, USA:Institute of Elec-trical and Electronic Engineers, 2013:3310-3315.
Outlines

/