OPEN ACCESS
In view of the many problems in firefighting robots, such as complicated flame positioning, poor environmental adaptability, and difficult installation and debugging, a new firefighting robot design is presented with video full closed-loop feedback to extinguish ground fire in this paper. The firefighting robot consists of a 2-DOF robot, a monocular camera, and a controller. The monocular camera installed on the second link of the robot is utilized to detect and locate ground flames. The robot can dynamically adjust the water landing point to track a flame in real-time through motion control, as the camera is specifically designed with an additional infrared narrowband pass filter and a filter-switching mechanism. An algorithm of detecting and positioning for flame and water landing point is proposed based on image processing and robotic kinematics. Experimental results show that the firefighting robot with video full closed-loop feedback can realize real-time flame detection, location, and sprinkler, and can dynamically track fire location within the monitoring scope. The distance error between fire and the landing point of the water jet can be controlled within a narrow range. Moreover, this firefighting robot is easy to install, debug and have good environment adaptability, and provides efficient and safe solutions for complicated firefighting environment. At the same time, due to its small size and convenient calibration features, this firefighting robot is especially suitable for large space environments.
firefighting robot, flame location, full closed-loop control video detection, water landing point detection.
[1] Bogue, R., Sensors for fire detection. Sensor Review, 33(2), pp. 99–103, 2013. http://dx.doi.org/10.1108/02602281311299635
[2] Liu, Z.G. & Kim, A.K., Review of recent developments in fire detection technologies. Journal of Fire Protection Engineering, 13(2), pp. 129–151, 2003. http://dx.doi.org/10.1177/1042391503013002003
[3] Ding, H.J., Fan, D. & Yao, H.W., Cable tunnel fire experiments based on linear temperature sensing fire detectors. Optics and Precision Engineering, 21(9), pp. 2225–2230, 2013. http://dx.doi.org/10.3788/OPE.20132109.2225
[4] Çetin, A.E., Dimitropoulos, K., Gouverneur, B., Grammalidis, N., Günay, O., Habiboglu, Y.H., Töreyin, B.U. & Verstockt, S., Video fire detection–review. Digital Signal Processing, 23(6), pp. 1827–1843, 2013. http://dx.doi.org/10.1016/j.dsp.2013.07.003
[5] Rehman, A., Masood, N., Arif, S., Shahbaz, U., Sarwar, F., Maqsood, K. & Pasha, M., Autonomous fire extinguishing system. Proceeding of International Conference on Robotics and Artificial Intelligence, IEEE Computer Society, Washington, pp. 218–222, 2012. http://dx.doi.org/10.1109/icrai.2012.6413387
[6] Ahmed, H., Mohanad, E., Nour, J. & Mohammed, E., An autonomous firefighting robot. Proceeding of the 17th International Conferences on Advanced Robotics, IEEE Robotics and Automation Society, Turkey, pp. 530–535, 2015.
[7] Hu, G.L. & Li, Z., Design and key technology research into autotargeting fire extinguishing system of interior large space. Proceeding of International Conferences on Electrical and Control Engineering, IEEE Computer Society, Piscataway, pp. 687–690, 2010.
[8] Yang, Q.M. & Sun, J.M., Design of an integrated location system for fire detecting robot. Proceeding of 4th International Conferences on Fuzzy Systems and Knowledge Discovery, Institute of Electrical and Electronics Engineers Inc., Piscataway, 3, pp. 327–330, 2007. http://dx.doi.org/10.1109/fskd.2007.243
[9] Pack, D.J., Robert, A., Ahigren, D.J. & Verner, I.M., Fire fighting mobile robotics and interdisciplinary design-comparative perspectives. IEEE Transactions on Education, 47(3), pp. 369–376, 2004. http://dx.doi.org/10.1109/TE.2004.825547
[10] Khoon, T.N., Sebastian, P. & Saman, A.B.S., Autonomous fire fighting mobile platform. Procedia Engineering, 41, pp. 1145–1153, 2012. http://dx.doi.org/10.1016/j.proeng.2012.07.294
[11] Wang, X.G., Lo, S. & Zhang, H., Exploring the role of feature subset combinations on performance of multisensor fire detection. Journal of Applied Fire Science, 23(2), pp. 179–192, 2013. http://dx.doi.org/10.2190/AF.23.2.e
[12] Pesatori, A. & Norgia, M., Infrared image system for fire location. Measurement, 46(10), pp. 4172–4178, 2013. http://dx.doi.org/10.1016/j.measurement.2013.07.040
[13] Wang, S.D., He, Y.P., Zou, J.J, Duan, B.B. & Wang, J., A flame detection synthesis algorithm. Fire Technology, 50(4), pp. 959–975, 2014. http://dx.doi.org/10.1007/s10694-012-0321-6
[14] Mahdipour, E. & Dadkhah, C., Automatic fire detection based on soft computing techniques review from 2000 to 2010. Artificial Intelligence Review, 42(4), pp. 895–934, 2014. http://dx.doi.org/10.1007/s10462-012-9345-z
[15] Kim, J.H., Joseph, S. & Brian, L., Firefighting robot stereo infrared vision and radar sensor fusion for imaging through smoke. Fire Technology, 51(4), pp. 823–845, 2015. http://dx.doi.org/10.1007/s10694-014-0413-6
[16] Zhang, Z.J., Shen, T. & Zou, J.H., An improved probabilistic approach for fire detection in videos. Fire Technology, 50(3), pp. 745–752, 2014. http://dx.doi.org/10.1007/s10694-012-0253-1
[17] Zhang, H.J., Zhang, N. & Xiao, N.F., Fire detection and identification method based on visual attention mechanism. Optik-International Journal for Light and Electron Optics, 126(24), pp. 5011–5018, 2015. http://dx.doi.org/10.1016/j.ijleo.2015.09.167
[18] Rossi, L., Akhloufi, M. & Tison, Y., On the use of stereovision to develop a novel instrumentation system to extract geometric fire fronts characteristics. Fire Safety Journal, 46(1), pp. 9–20, 2011. http://dx.doi.org/10.1016/j.firesaf.2010.03.001
[19] Verstockt, S., Van Hoecke, S., Tilley, N., Merci, B., Sette, B., Lambert, P., Hollemeersch, C.F.J. & Van De Walle, R., Firecube: a multi-view localization framework for 3D fire analysis. Fire Safety Journal, 46(5), pp. 262–275, 2011. http://dx.doi.org/10.1016/j.firesaf.2011.03.001
[20] Hsu, C.C., Lu, M.C., Wang, W.Y. & Lu, Y.Y., Distance measurement based on pixel variation of CCD images. ISA Transactions, 48(4), pp. 389–395, 2009. http://dx.doi.org/10.1016/j.isatra.2009.05.005
[21] Li, G.D., Lu, G. & Yan, Y., Fire detection using stereoscopic imaging and image processing techniques. Proceeding of International Conferences on Imaging Systems and Techniques, IEEE Instrument and Measurement Society, Greece, pp. 28–32, 2014. http://dx.doi.org/10.1109/ist.2014.6958440
[22] Verstockt, S., Van, H.S., Tilley, N., Merci, B., Sette, B., Lambert, P., Hollemeersch, C. & Vande, W.R., Fire cube: a multi-view localization framework for 3D fire analysis. Fire Safety Journal, 46(5), pp. 262–275, 2011. http://dx.doi.org/10.1016/j.firesaf.2011.03.001
[23] Lauer, M., Miriam, S., Lange, S. & Welker, S., 3D-objecttracking with a mixed omnidirectional stereo camera system. Mechatronics, 21(2), pp. 390–398, 2011. http://dx.doi.org/10.1016/j.mechatronics.2010.05.007
[24] Xin, Y.B., Sai, T., Jiang, F.H., Yin, R., Yao, B., Zhang, K.N. & Liu, B.H., An experimental study of automatic water cannon systems for fire protection of large open spaces. Fire Technology, 50(2), pp. 233–248, 2014. http://dx.doi.org/10.1007/s10694-013-0363-4
[25] Qiang, L., Estimation of fire detection time. Procedia Engineering, 11, pp. 233–241, 2011. http://dx.doi.org/10.1016/j.proeng.2011.04.652
[26] Foggia, P., Saggese, A. & Vento, M., Real-time fire detection for video surveillance applications using a combination of experts based on color, shape and motion. IEEE Transactions on Circuits and Systems for Video Technology, 25(9), pp. 1545–1556, 2015. http://dx.doi.org/10.1109/TCSVT.2015.2392531
[27] Escarra, M.D., Le, L.T., Urban, N.M., Oppenheimer, M. & Gmachl, C.F., Quantum cascade laser-based sensing for carbon sequestration leakage monitoring. IEEE Sensors Journal, 13(6), pp. 2348–2356, 2013. http://dx.doi.org/10.1109/JSEN.2013.2253731
[28] Zhou, J., Gao, Y.H., Liu, C.Y. & Zhang, Y.C., Attitude calculation of single camera visual system based on adaptive algorithm. Optics and Precision Engineering, 20(12), pp. 2796–2803, 2012. http://dx.doi.org/10.3788/OPE.20122012.2796
[29] Iyogun, C.O., Birouk, M. & Popplewell, N., Trajectory of water jet exposed to low subsonic cross-flow. Atomization and Sprays, 16(8), pp. 963–979, 2006. http://dx.doi.org/10.1615/AtomizSpr.v16.i8.70
[30] Sun, W.L., Research on intelligent fire systems based on computer vision. Graduate University of Nanjing University of Aeronautics and Astronautics, Nanjing, 2011.
[31] Xuan Truong, T. & Kim, Jong-M., Fire flame detection in video sequences using multistage pattern recognition techniques. Engineering Applications of Artificial Intelligence, 25(7), pp. 1365–1372, 2012. http://dx.doi.org/10.1016/j.engappai.2012.05.007
[32] Zhao, H.W., Chen, X., Liu, P.P. & Geng, Q.T., Adaptive segmentation for visual salient object. Optics and Precision Engineering, 21(2), pp. 531–538, 2013. http://dx.doi.org/10.3788/OPE.20132102.0531