Comparison of Eye Detection Methods using Image Processing

 
 
 
  • Abstract
  • Keywords
  • References
  • PDF
  • Abstract


    Driver fatigue is major factor in more number of vehicle accidents on road.  Statistics from Transport Accident Commission shows that nearly 20% of fatal road accidents involve fatigue. National Highway Traffic Safety Administration estimate that nearly 2,000 deaths, 70,000 injuries and $12.5 billion of financial losses occur annually. The development of technologies for detecting and preventing fatigue at the wheel is a major challenge faced by accident avoidance systems. Measurement of fatigue becomes difficult as it becomes more pronounced. During last decade, lot of research work has been carried out development of fatigue detection system for avoiding accidents on road. It is the summary of all related work carried out, the methods and components required in this research. The drawbacks of the existing methods, advantages and limitations are discussed in this paper. There are many technologies for Fatigue detection which are divided into biological indicators, vehicle behaviour and face analysis. This paper is a part of research work on the project “Development of Non-Intrusive Driver Fatigue Detection & Warning System to avoid on road Accidents” sanctioned under Early Career Research Award sponsored by Science & Engineering Research Board ,Govt. of India ,New Delhi at Vignan Institute of Technology & Science, Vignan Hills, Hyderabad.

     

     


  • Keywords


    Face, Eye, Driver, Fatigue, Skin

  • References


      [1] A Jackson, P., Hilditch, C., Holmes, A., Reed, N., Merat, N. & Smith, L. “Fatigue and Road Safety: A Critical Analysis of Recent Evidence”, Road Safety Web Department for Transport, Publication No. 21, (2011).

      [2] Karamjeet Singh, Rupinder Kaur,”Physical and Physiological Drowsiness Detection Methods”, International Journal of IT, Engineering and Applied Sciences Research, pp.35-43, Volume 2, (2013).

      [3] Eoh,H.J., Chung,M.K, and Kim,S.H., “Electroencephalographic study of drowsiness in simulated driven with sleep deprivation,” International Journal of Industrial Ergonomics,Volume 35, pp.307-320, (2005).

      [4] Lal,S.K.L., Craig,A., Boord,P., Kirkup,L., and Nguyen,H., “Development of an algorithm for an EEG-based driver fatigue countermeasure,” Journal of Safety Research, Volume 34, pp. 321-328, (2003).

      [5] Elsenbruch,S., Harnish,M., and Orr,W.C., “Heart rate variability during waking and sleep in healthy males and females,” Sleep, Volume 22, pp.1067-1071, (1999).

      [6] Toscani,L., Gangemi,P.F., Parigi,A., Silipo,R., Ragghianti, P., Sirabella,E., Morelli, M.,Bagnoli,L., Vergassola,R., and Zaccara,G., “Human heart rate variability and sleep stages,” The Italian Journal of Neurological Sciences, Volume 17, pp. 437-439, (1996).

      [7] Bonnet,M.H., and Arand, D.L.,“Heart rate variability: sleep stage, time of night, and arousal influences”, Electroencephalography and Clinical Neurophysiology, Volume 102, pp.390-396, (1997).

      [8] Jurysta,F., Van de Borne,P., Migeotte, P.F., Dumont,M., Lanquart,J.P., Degaute, J.P.,and Linkowski,P., “A study of the dynamic interactions between sleep EEG and heart rate variability in healthy young men,” Clinical Neurophysiology, Volume 114, pp. 2146-2155, (2003).

      [9] Vanoli,E., Adamson,P.B., Lin,B., Pinna,G.D., Lazzara,R., and Orr,W.C., “Heart Rate Variability During Specific Sleep Stages - A Comparison of Healthy Subjects With Patients After Myocardial Infarction,” Circulation, Volume 91, pp. 1918-1922, (1995).

      [10] Tsunoda,M., Endo,T., Hashimoto,S., Honma,S., and Honma, K.,I., “Effects of light and sleep stages on heart rate variability in humans,” Psychiatry and Clinical Neurosciences,Volume 55, pp. 285-286, (2001).

      [11] Uno,H., “Detection Decline in Arousal Level Using Combined Physiological and Behavioral Measures,” Japan Automobile Research Institute, Volume 25 No.8, (2003).

      [12] McCall,J., and Trivedi,M., “Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation,” IEEE Trans. Intelligent Transportation Systems, Volume 7, no. 1, (2006).

      [13] P.Sudhakar Rao, Vijayalaxmi, S.Sreehari, “New procedure for Segmenting Eyes from human Face”, International Journal of Emerging Technologies and Applications in Engineering, Technology and Sciences, ISSN:0974-3588 July-Dec, Volume 4,Issue 2,(2011).

      [14] Jones, M. J., and Rehg, J. M., “Statistical color models with application to skin detection”, In Procedings of the CVPR , Volume. 1, pp.274–280,(1999).

      [15] Signal,L., Sclaroff,S., and Athatsos,V., “Estimation and prediction of evolving colour distributions for skin segmentation under varying illumination”, In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Volume 2, pp.152–159,(2000).

      [16] Lingmin Meng and Nguyen,T.Q., "Frontal face localization using linear discriminant", in Signals, Systems, and Computers, 1999. Conference Record of the Thirty-Third Asilomar Conference on, pp. 745-749 Volume 1,(1999).

      [17]

      [18] Tsai,D., and Lin,C., "Fast normalized cross correlation for defect detection", Pattern Recog. Lett., Volume 24, pp. 2625-2631, 11, (2003).

      [19] Shou-Der Wei and Shang-Hong Lai, "Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update", Image Processing, IEEE Transactions on, Volume 17, pp. 2227-2235, (2008).

      [20] Atallah,M.J., "Faster image template matching in the sum of the absolute value of differences measure," Image Processing, IEEE Transactions on, Volume 10, pp. 659-663, (2001).

      [21] Yuille, A., Hallinan,A., Cohen,D., “Feature extraction from faces using deformable templates”, International Journal of Computer Vision 8 (2),pp. 99-111, (1992).

      [22] Black,M.J., Yacoob,Y., “Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion”, International Journal of Computer Vision. Volume 25(1), October, pp. 23 – 48,( 1997).

      [23] Qiong Wang, Jingyu Yang, “Eye detection in facial images with unconstrained background”, Journal of pattern recognition research 1, published 25 Sep 2006, pp.55-62, (2006).

      [24] Qiong Wang, Jingyu Yang, “Eye location & eye state detection in facial images with unconstrained background”, Journal of information and computing science, Volume 1, No.5, pp.284-289, (2006).

      [25] Hawlader Abdullah Al-Mamun, Nadim Jahangir, Md. Shahedul Islam and Md. Ashraful Islam, “Eye Detection in Facial Image by Genetic Algorithm Driven Deformable Template Matching”, Volume 9, August, (2009).

      [26] Mihir Jain, Suman Mitra,K., Naresh Jotwani,D., “Eye detection using line edge MAP template”,(2008).

      [27] Jeffrey Huang, David Lie, Xuhui Shao, Harry Wechsler, “Pose Discrimination and Eye Detection using SVM”, Proceeding of NATO-ASI on Face Recognition: From Theory to Applications, (1998).

      [28] Hyoung-Joon Kim and Whoi-Yul Kim, “Eye detection in facial images using Zernike moments with SVM”, ETRI journal, Volume 30, Nov,2, pp. 335-337,April (2008).

      [29] Shylaja S.S, Balasubramanya Murthy,K.N., Natarajan, S., Nischith, Muthuraj R, Ajay S, “Feed forward neural network based eye localization and recognition using Hough transform”, International journal of advanced computer science and applications, Volume 2, No.3, pp.104-109, March(2011).

      [30] Rakhi C Motwani, Mukesh C Motwani, Dr.Frederick C. Harris,Jr., “Eye Detection using Wavelets and ANN”,(2002).

      [31] Kawato,S. Ohya,J., “Real-time detection of nodding and head-shaking by directly detecting and tracking”,(2003).

      [32] Feng,G.C., Yuen,P.C., “Variance projection function and its application to eye detection for human face recognition”, International Journal of Computer Vision 19,pp.899-906, (1998).

      [33] Jiao, F., and He,G., “Real-Time Eye Detection and Tracking under Various Light Conditions”, Data Science Journal, 6(0),pp.636–640, (2007).

      [34] Junior,O.S.,Silva,A.C., and Abdelouah,Z., “Personal Identification Based on Iris Texture Analysis Using Semivariogram and Correlogram Functions”, International Journal for Computacional Vision and Biomechanics, (2009). 2(1).

      [35] Peters, R. D., Kloeppel, E., & Alicandri, E. “ Effects of partial and total sleep deprivation on driving performance”, US Department of Transportation, Federal Highway Administration (Eds), Publication No. FHWA-RD-94-046 (1999).

      [36] Artaud et.al, Mabbott et.al, Lavergne et.al, Vitabile et.al, Eskandarian.A & R.Sayed in , “Monitoring the response of drivers”,( 1994),(1999),(1996),2007-08),(2005).

      [37] Martin Gallagher, “Development of a driver alert system for road safety”, in (2006-07).

      [38] Srijayathi,K., Vedachary,M., “Implementation of the Driver Drowsiness Detection System”, International Journal of Science, Engineering and Technology Research (IJSETR),Volume 2, Issue 9, September (2013).

      [39]

      [40] Akin M., Kurt M., Sezgin N., Bayram M, “Estimating vigilance level by using EEG and EMG signals”, Neural Comput. Applications, 17,pp.227–236,(2008).

      [41] Fu C.L., Li W.K., Chun H.C., Tung P.S., Chin T.L., “Generalized EEG-based drowsiness prediction system by using a self-organizing neural fuzzy system”, IEEE Transaction Circuits. Systems,59, pp.2044–2055,(2012).

      [42] Chin T.L., Che J.C., Bor S.L., Shao H.H., Chih F.C., Wang I.J., “A real-time wireless brain-computer interface system for drowsiness detection”, IEEE Transactions Biomedical Circuits Systems, 4,pp.214–222,(2010).

      [43] Liu J., Zhang C., Zheng C., “EEG-based estimation of mental fatigue by using KPCA-HMM and complexity parameters”, Biomedical Signal Processing Controls, 5, pp.124–130,(2010).

      [44] Yang, M.H., Kriegman, D., and Ahuja, N, “Detecting faces in images: A survey”, IEEE Transactions on Pattern Analysis & Machine Intelligence”, Vol.24, No.1, pp.34–58,(2002).

      [45] Lin,C.T., Wu,R.C., Liang,S.F., Chao, W.H., Chen,Y.J., and Jung,T.P., “EEG-based drowsiness estimation for safety driving using independent component analysis,” IEEE Transaction on Circuits and Systems, vol. 52, pp. 2726-2738, (2005).

      [46] Calcagnini,G., Biancalana, G., Giubilei,F., Strano, S. and Cerutti,S., “Spectral analusis of heart rate variability signal during sleep stages,” Proceedings of the 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2, pp.1252-1253, (1994).

      [47] Wylie,C., Shultz,T., Miller,J., Mitler,M., Mackie,R., “Commercial Motor Vehicle Driver Fatigue and Alertness Study: Technical Summary,” FHWA-MC-97-001, (1996).

      [48] Otmani,S., Pebayle,T., Roge,J., Muzet,A., “Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers,” Physiological Behaviour, (2005).

      [49] Bertozzi,M., et al., “Knowledge-Based Intelligent Information and Engineering Systems,” B. Appolloi et al., eds., Springer, (2007).

      [50] Sahyadehas,A., Sundaraj,K. and Murugappan,M., “Detecting Driver Drowsiness based on Sensors: A Review,” (2012).

      [51] Ingre,M., ÅKerstedt,T., Peters,B., Anund,A., Kecklund,G., “Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences,” J. Sleep Res., (2006).

      [52] Daimer,A.G., “The Electronic Drawbar”, June (2001). [Online].

      [53] Mohammed Saaidia, Sylvie Lelandais, “Face detection by neural network trained with Zernike moments”, Vincent Vigneron Proceedings of the 6th WSEAS International Conference on Signal Processing, Robotics and Automation, Corfu Island, Greece, February 16-19, (2007).

      [54] Zhao,W., Chellappa, R., Rosenfeld, A. and Phillips,P., “Face recognition: A literature survey”, ACM Computing Surveys, pp.399–458, (2003).

      [55] Bruner,J.S. and Tagiuri,R., “The percepton of people”, Handbook of Social Psycology, 2(17), (1954).

      [56] Yang,M.H., Kriegman, D. J., and Ahuja,N., “Detecting faces in images: A survey”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1),pp.34–58, January (2002).

      [57] Vezhnevets,V., Sazonov,V., Andreeva, A., “A survey on pixel-based skin colour detection techniques”, GRAPHICON03, pp. 85–92,(2003).

      [58] Brown, D., Craw,I., Lewthwaite,J., “A SOM based approach to skin detection with application in real time systems”, BMVC01, (2001).

      [59] Greenspan,H., Goldberger,J., Eshet, I., “Mixture model for facecolor modeling and segmentation”, Pattern Recognition Lett. 22 (14),pp.1525–1536,(2001).

      [60] Hsu,R.L., Abdel-Mottaleb,M., Jain,A.K., “Face detection in colour images”, IEEE Transaction Pattern Analysis Machine Intelligence, 24 (5),pp.696–706,(2002).

      [61] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparison”, IEEE Transaction Pattern Analysis Machine Intelligence 27 (1) (2005).

      [62] Yang,M.H., Ahuja,N., “Gaussian Mixture model for human skin colour and its application in image and video databases”, Proceedings of SPIE: Conference on Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 458–466,(1999).

      [63] Brand,J., Mason,J., “A comparative assessment of three approaches to pixel level human skin-detection”, ICPR011,pp.1056–1059, (2000).

      [64] Martinkauppi, B., and Soriano, M. 2001, “Basis functions of the color signals of skin under different illuminants”, 3rd International Conference on Multispectral Colour Science, pp.21–24, (2001).

      [65] Shin, M. C., Chang, K. I., and Tsap, L. V., “Does colourspace transformation make any difference on skin detection”, IEEE Workshop on Applications of Computer Vision, (2002).

      [66] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparison”, IEEE Transaction Pattern Analysis Machine Intelligence, 27 (1) (2005).

      [67] Guoliang Yang, Huan Li, Li Zhang, Yue Cao, “Research on a Skin Colour Detection Algorithm Based on Self Adaptive Skin Colour Model, International Conference on Communications and Intelligence Information Security, 978-0-7695-4260-7/10,(2010).

      [68] Abbas Cheddad, Joan Condell, Kevin Curran and Paul Mc Kevitt, “A New color space for skin detection”, ICIP ,978-1-4244-5654-3/09,(2009).

      [69] Zhang Zhengzhen, Shi Yuexiang, “Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Space”, 9781-4244-3986-7, (2009).

      [70] Jouglas Alves Tomaschitz, Jacques Facon, “Skin Detection applied to Multi-racial Images” , 978-1-4244-4530-1,(2009).

      [71] Kirby,M., and Sirovich,L., “Application of the karhunen-loeve procedure for the characterization of human faces”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(1),pp.103–108, (1990).

      [72] Pigeon, S., and Vandendrope, L., “The M2VTS multimodal face database”, In Proceedings First International Conference on Audio- and Video Based Biometric Person Authentication, (1997).

      [73] Jain, A., Duin,R., and Mao,J., “Statistical pattern recognition: A review”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1),pp.4–37, January (2000).

      [74] Ji,Q., Yang, S., “Real time visual cues extraction for monitoring driver vigilance”, Proceedings of International Workshop on Computer Vision Systems, Vancouver, Canada, (2001).

      [75] Ji,Q., Zhu,Z., “Eye and gaze tracking for interactive graphic display”, 2nd International Symposium on Smart Graphics, Hawthorne, NY, USA, (2002).

      [76] Bisawa,Y.E., Satoh,S., “Effectiveness of pupil area detection technique using two light sources and image difference method”, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 1268-1269,(1993).

      [77] Ebisawa,Y., “Improved video-based eye-gaze detection method”, IEEE Transcations on Instrumentation and Measurement 47 (2) pp.948-955, (1998).

      [78] Haro,A., Flickner,M., Essa,I., “Detecting and tracking eyes by using their physiological properties, dynamics, and appearance”, Proceedings IEEE CVPR 2000, Hilton Head Island, South Carolina, (2000).

      [79] Zhiwei Zhu, Qiang Ji, “Robust Real-Time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientations”, Preprint submitted to Elsevier Science, 5 July,(2004).

      [80] Nixon,M., “Eye spacing measurement for facial recognition”, Proceedings of the Society of Photo-Optical Instrument Engineers, (1985).

      [81] Deng,J., Lai,F., “Region-Based Template Deformation and Masking for Eye-feature Extraction and Description”, Pattern Recognition, 30(3),pp.403–419, (1997).

      [82] A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, (1994).

      [83] Reinders,M., Koch,R., Gerbrands,J., “Locating facial features in image sequences using neural networks”, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, USA, (1997).

      [84] Zhiwei Zhu, Quing Ji, “Robust real time eye detection and tracking under variable lighting conditions and various face orientations”, Preprint submitted to Elseiver Science , July 5, (2004).

      [85] Feng,G.C., Yuen,P.C., “Multi-cues eye detection on gray intensity image”, Pattern recognition, 34,pp.1033-1046,(2001).

      [86] Brand,J., Mason,J., “A comparative assessment of three approaches to pixel level human skin-detection”, ICPR011,pp.1056–1059, (2000).

      [87] Martinkauppi, B., and Soriano, M. 2001, “Basis functions of the color signals of skin under different illuminants”, 3rd International Conference on Multispectral Colour Science, pp.21–24, (2001).

      [88] Shin, M. C., Chang, K. I., and Tsap, L. V., “Does colourspace transformation make any difference on skin detection”, IEEE Workshop on Applications of Computer Vision, (2002).

      [89] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparison”, IEEE Transaction Pattern Analysis Machine Intelligence, 27 (1) (2005).

      [90] Guoliang Yang, Huan Li, Li Zhang, Yue Cao, “Research on a Skin Colour Detection Algorithm Based on Self Adaptive Skin Colour Model, International Conference on Communications and Intelligence Information Security, 978-0-7695-4260-7/10,(2010).

      [91] Abbas Cheddad, Joan Condell, Kevin Curran and Paul Mc Kevitt, “A New color space for skin detection”, ICIP ,978-1-4244-5654-3/09,(2009).

      [92] Zhang Zhengzhen, Shi Yuexiang, “Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Space”, 9781-4244-3986-7, (2009).

      [93] Jouglas Alves Tomaschitz, Jacques Facon, “Skin Detection applied to Multi-racial Images” , 978-1-4244-4530-1,(2009).

      [94] Kirby,M., and Sirovich,L., “Application of the karhunen-loeve procedure for the characterization of human faces”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(1),pp.103–108, (1990).

      [95] Pigeon, S., and Vandendrope, L., “The M2VTS multimodal face database”, In Proceedings First International Conference on Audio- and Video Based Biometric Person Authentication, (1997).

      [96] Jain, A., Duin,R., and Mao,J., “Statistical pattern recognition: A review”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1),pp.4–37, January (2000).

      [97] Ji,Q., Yang, S., “Real time visual cues extraction for monitoring driver vigilance”, Proceedings of International Workshop on Computer Vision Systems, Vancouver, Canada, (2001).

      [98] Ji,Q., Zhu,Z., “Eye and gaze tracking for interactive graphic display”, 2nd International Symposium on Smart Graphics, Hawthorne, NY, USA, (2002).

      [99] Bisawa,Y.E., Satoh,S., “Effectiveness of pupil area detection technique using two light sources and image difference method”, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 1268-1269,(1993).

      [100] Ebisawa,Y., “Improved video-based eye-gaze detection method”, IEEE Transcations on Instrumentation and Measurement 47 (2) pp.948-955, (1998).

      [101] Haro,A., Flickner,M., Essa,I., “Detecting and tracking eyes by using their physiological properties, dynamics, and appearance”, Proceedings IEEE CVPR 2000, Hilton Head Island, South Carolina, (2000).

      [102]

      [103] Zhiwei Zhu, Qiang Ji, “Robust Real-Time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientations”, Preprint submitted to Elsevier Science, 5 July,(2004).

      [104] Nixon,M., “Eye spacing measurement for facial recognition”, Proceedings of the Society of Photo-Optical Instrument Engineers, (1985).


 

View

Download

Article ID: 30916
 
DOI: 10.14419/ijet.v7i4.6.30916




Copyright © 2012-2015 Science Publishing Corporation Inc. All rights reserved.