A Survey on Unimodal, Multimodal Biometrics and Its Fusion Techniques
Abstract
Presently, a variety of biometric modalities are applied to perform human identification or user verification. Unimodal biometric systems (UBS) is a technique which guarantees authentication information by processing distinctive characteristic sequences and these are fetched out from individuals. However, the performance of unimodal biometric systems restricted in terms of susceptibility to spoof attacks, non-universality, large intra-user variations, and noise in sensed data. The Multimodal biometric systems defeat various limitations of unimodal biometric systems as the sources of different biometrics typically compensate for the inherent limitations of one another. The objective of this article is to analyze various methods of information fusion for biometrics, and summarize, to conclude with direction on future research proficiency in a multimodal biometric system using ECG, Fingerprint and Face features. This paper is furnished as a ready reckoner for those researchers, who wish to persue their work in the area of biometrics.
About this article
Keywords
- Authentication
- verification
- unimodal
- multi-modal
- face
- finger
- ECG
- biometrics.
References
[1] Zhang DD, Automated biometrics: Technologies and systems, Springer Science & Business Media, (2013).
[2] Unar JA, Seng WC & Abbasi A, “A review of biometric technology along with trends and prospects”, Pattern recognition, Vol.47, No.8, (2014), pp.2673-2688.
[3] Lumini A & Nanni L, “Overview of the combination of biometric matchers”, Information Fusion, Vol.33, (2017), pp.71-85.
[4] Raju AS & Udayashankara V, “Biometric person authentication: A review”, IEEE International Conference on Contemporary Computing and Informatics (IC3I), (2014), pp.575-580.
[5] Jain AK, Ross A & Prabhakar S, “An Introduction to Biometric Recognition”, IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Image- and Video-Based Biometrics, Vol.14, No.1, (2004), pp.4–20.
[6] Pouryayevali S, ECG biometrics: new algorithm and multimodal biometric system (Doctoral dissertation), (2015), pp.1-93.
[7] Biel L, Pettersson O, Philipson L & Wide P, “ECG analysis: a new approach in human identification”, IEEE Trans. Instrum. Meas., Vol.50, No.3, (2001), pp.808-812.
[8] Kyoso M & Uchiyama A, “Development of an ECG identification system”, IEEE 23rd annual international conference of the Engineering in medicine and biology society, Vol.4, (2001), pp.3721-3723.
[9] Shen TW, Tompkins WJ & Hu YH, “One-lead ECG for identity verification”, IEEE 24th annual conference and the annual fall meeting of the biomedical engineering society embs/bmes, Engineering in medicine and biology, Vol.1, (2002), pp.62-63.
[10] Kim KS, Yoon TH, Lee JW, Kim DJ & Koo HS, “A robust human identification by normalized time-domain features of electrocardiogram”, IEEE 27th annual international conference of the Engineering in medicine and biology society, (2006), pp.1114-1117.
[11] Chan ADC, Hamdy MM, Badre A & Badee V, “Wavelet distance measure for person identification using electrocardiograms”, IEEE Trans. Instrum. Meas., Vol.57, No.2, (2008), pp.248-253.
[12] Agrafioti F & Hatzinakos D, “ECG based recognition using second order statistics”, IEEE Conference on Communication Networks and Services Research, (2008), pp.82-87.
[13] Safie SI, Soraghan JJ & Petropoulakis L, “Electrocardiogram (ECG) biometric authentication using pulse active ratio (PAR)”, IEEE Transactions on Information Forensics and Security, Vol.6, No.4, (2011), pp.1315-1322.
[14] Zhao Z, Yang L, Chen D & Luo Y, “A human ecg identi_cation system based on ensemble empirical mode decomposition”, Sensors, Vol.13, No.5, (2013), pp.6832-6864.
[15] Odinaka I, Lai PH, Kaplan AD, O'Sullivan JA, Sirevaag EJ, Kristjansson SD & Rohrbaugh JW, “ECG biometrics: A robust short-time frequency analysis”, IEEE international workshop on Information forensics and security (wifs), (2010), pp.1-6.
[16] Ross AA, Nandakumar K & Jain AK, Handbook of multibiometrics. Springer Science & Business Media, (2006).
[17] Senthilkumar R & Gnanamurthy RK, “HANFIS: a new fast and robust approach for face recognition and facial image classification”, Smart Innovations in Communication and Computational Sciences, (2019), pp.81-99.
[18] Raju K & Srinivasa Rao Y, “A Novel Fusion Based Hybrid Approach For Face Recognition System”, Journal of Theoretical and Applied Information Technology, Vol.95, No.9, (2017), pp.2054-2069.
[19] Amrutha B & John PV, “Efficient Implementation on Human Face Recognition under Various Expressions using LoG, LBP and SVM”, International Journal of Engineering Science and Computing, Vol.7, No.7, (2017), pp14052-14055.
[20] Ancy AV & Devi M, “Aging Face Recognition Along with Personal Identification using Local Patterns Selection”, International Journal of Engineering Science and Computing, Vol.7, No.5, (2017), pp.11396-11399.
[21] Azad AA, Hardi MM & Zrar KA, “Wavelet-Local binary pattern based face recognition”, International Journal of Computers & Technology, Vol.16, No.1, (2017), pp.7552-7556.
[22] Sharadamani D & Nagaraju C, “Face Recognition Using Gradient Derivative Local Binary Patterns”, International Journal of Applied Engineering Research, Vol.12, No.7, (2017), pp.1316-1323.
[23] Hamayun AK, “Feature Fusion and Classifier Ensemble Technique for Robust Face Recognition”, Signal Processing: An International Journal (SPIJ), Vol.11, No.1, (2017), pp.1-15.
[24] Saloni D & Nitika G, “A New Hybrid Approach on Face Detection and Recognition”, International Journal of Advance Research, Ideas and Innovations in Technology, Vol.3, No.3, (2017), pp.485-492.
[25] Rupali SP, Sonali DP & Sudeep DT, “Performance Evaluation of Fingerprint Trait Authentication System”, International Conference on Intelligent Computing and Applications, Advances in Intelligent Systems and Computing, Vol.632, (2018), pp.143-151.
[26] Debnath B, Das JC & De D, “Fingerprint authentication using QCA technology”, IEEE Devices for Integrated Circuit (DevIC), (2017), pp.125-130.
[27] Patil PB & Patil NN, “Fingerprint combination using extraction of minutiae position and orientation. IEEE International Conference on Emerging Trends in Engineering, Technology and Science (ICETETS), (2016), pp.1-6.
[28] Yang F, Paindavoine M, Abdi H & Monopoli A, “Development of a fast panoramic face mosaicking and recognition system”, Optical Engineering, Vol.44, No.8, (2005).
[29] Zhang YL, Yang J & Wu HT, “A hybrid swipe fingerprint mosaicing scheme”, International Conference on Audio-and Video-Based Biometric Person Authentication, (2005), pp.131-140.
[30] Marcialis GL, Roli F & Didaci L, “Personal identity verification by serial fusion of fingerprint and face matchers”, Pattern recognition, Vol.42, No.11, (2009), pp.2807-2817.
[31] Vatsa M, Singh R & Noore A, “Unification of evidence-theoretic fusion algorithms: A case study in level-2 and level-3 fingerprint features”, IEEE Trans. Syst. Man, Cybern. Part ASystems Humans, (2009), pp.47–56.
[32] Nanni L & Lumini A, “Descriptors for image-based fingerprint matchers”, Expert Systems with Applications, Vol.36, No.10, (2009), pp.12414-12422.
[33] Vatsa M, Singh R, Noore A & Ross A, “On the dynamic selection of biometric fusion algorithms”, IEEE Transactions on Information Forensics and Security, Vol.5, No.3, (2010), pp.470-479.
[34] Kumar A & Shekhar S, “Personal identification using multibiometrics rank-level fusion”, IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews, Vol.41, No.5, (2011), pp.743-752.
[35] Monwar MM & Gavrilova M, “Markov chain model for multimodal biometric rank fusion”, Signal, Image and Video Processing, Vol.7, No.1, (2013), pp.137-149.
[36] Nagar A, Nandakumar K & Jain AK, “Multibiometric cryptosystems based on feature-level fusion”, IEEE transactions on information forensics and security, Vol.7, No.1, (2012), pp.255-268.
[37] Yang J & Zhang X, “Feature-level fusion of fingerprint and finger-vein for personal identification”, Pattern Recognition Letters, Vol.33, No.5, (2012), pp.623-628.
[38] Zokaee S & Faez K, “Human identification based on electrocardiogram and palmprint”, International Journal of Electrical and Computer Engineering (IJECE), Vol.2, No.2, (2012), pp.261-266.
[39] Chan CH, Tahir MA, Kittler J & Pietikäinen M, “Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.35, No.5, (2013), pp.1164-1177.
[40] Huang Z, Liu Y, Li C, Yang M & Chen L, “A robust face and ear based multimodal biometric system using sparse representation”, Pattern Recognition, Vol.46, No.8, (2013), pp.2156-2168.
[41] Goswami G, Mittal P, Majumdar A, Vatsa M & Singh R, “Group sparse representation based classification for multi-feature multimodal biometrics”, Information Fusion, Vol.32, (2016), pp.3-12.
[42] Poh N, Ross A, Lee W & Kittler J, “A user-specific and selective multimodal biometric fusion strategy by ranking subjects”, Pattern Recognition, Vol.46, No.12, (2013), pp.3341-3357.
[43] Bhatt HS, Singh R & Vatsa M, “On recognizing faces in videos using clustering-based re-ranking and fusion”, IEEE Transactions on Information Forensics and Security, Vol.9, No.7, (2014), pp.1056-1068.
[44] Zhang Z, Wang Y & Zhang Z, “Face synthesis from low-resolution near-infrared to high-resolution visual light spectrum based on tensor analysis”, Neurocomputing, Vol.140, (2014), pp.146-154.
[45] Gogoi M & Bhattacharyya DK, Proceedings of the Third International Conference on Soft Computing for Problem Solving, Springer India, New Delhi, (2014).
[46] Li C, Hu J, Pieprzyk J & Susilo W, “A new biocryptosystem-oriented security analysis framework and implementation of multibiometric cryptosystems based on decision level fusion”, IEEE transactions on Information Forensics and Security, Vol.10, No.6, (2015), pp.1193-1206.
[47] Mehrotra H, Singh R, Vatsa M & Majhi B, “Incremental granular relevance vector machine: A case study in multimodal biometrics”, Pattern Recognition, Vol.56, (2016), pp.63-76.
[48] Hanmandlu M, “Multimodal biometric system built on the new entropy function for feature extraction and the Refined Scores as a classifier”, Expert Systems with Applications, Vol.42, No.7, (2015), pp.3702-3723.
[49] Nguyen K, Denman S, Sridharan S & Fookes C, “Score-level multibiometric fusion based on Dempster–Shafer theory incorporating uncertainty factors”, IEEE Transactions on Human-Machine Systems, Vol.45, No.1, (2015), pp.132-140.
[50] Bharadwaj S, Bhatt HS, Singh R, Vatsa M & Noore A, “QFuse: Online learning framework for adaptive biometric system”, Pattern Recognition, Vol.48, No.11, (2015), pp.3428-3439.
[51] Celik N, Manivannan N, Balachandran W & Kosunalp S, “Multimodal biometrics for robust fusion systems using logic gates”, Journal of Biometrics & Biostatistics, Vol.6, No.1, (2015).
[52] Manjunathswamy BE, Appaji MA, Thriveni J, Venugopal KR & Patnaik LM, “Article: Multimodal Biometric Authentication using ECG and Fingerprint”, International Journal of Computer Applications, Vol.111, No.13, (2015), pp.33-39.
[53] Afshan A & Isha V, “The Framework Design For Increasing Security Of Multi-Modal Biometric Authentication System With DNN”, International Journal of Advanced Research in Computer Science, Vol.8, No.8, (2017), pp.343-348.
[54] Wang R, Han C, Wu Y & Guo T, “Fingerprint classification based on depth neural network”, arXiv preprint arXiv:1409.5188.. (2014), pp.1-14.
[55] Kouamo S & Tangha C, “Fingerprint recognition with artificial neural networks: application to e-learning”, Journal of Intelligent Learning Systems and Applications, Vol.8, No.02, (2016), pp.39-49.
[56] Gawande U, Golhar Y & Hajari K, “Biometric-based security system: issues and challenges”, Intelligent Techniques in Signal Processing for Multimedia Security, (2017), pp.151-176.
[57] Hambalık PMA, “Fingerprint recognition system using artificial neural network as feature extractor: design and performance evaluation”, Tatra Mt. Math. Publ, Vol.67, (2016), pp.117-134.
[58] Xiaona X, Xiuqin P, Yue Z & Qiumei P, “Research on kernel-based feature fusion algorithm in multimodal recognition”, IEEE International Conference on Information Technology and Computer Science, (2009), pp.3-6.
[59] Mahoor MH, Cadavid S & Abdel-Mottaleb M, “Multi-modal ear and face modeling and recognition”, 16th IEEE International Conference on Image Processing (ICIP), (2009), pp.4137-4140.
[60] Darwish AA, Abd Elghafar R & Fawzi Ali A, “Multimodal Face and Ear Images”, Journal of Computer Science, Vol.5, No.5, (2009), pp.374-379.
[61] Muhammad IR, Rubiyah Y & Marzuki K, “Multimodal face and finger veins biometric authentication”, Scientific Research and Essays, Vol.5, No.17, (2010), pp.2529-2534.
[62] Mohamed S, Noureddine D & Noureddine G, “Face and Speech Based Multi-Modal Biometric Authentication”, International Journal of Advanced Science and Technology, Vol.21, No.8, (2010), pp.41-46.
[63] Piotr D & Andrzej C, “Human-Computer Interface Based on Visual Lip Movement and Gesture Recognition”, International Journal of Computer Science and Applications, Vol.7, No.3, (2010), pp.124-139.
[64] Linlin S, Li B & Zzhen Ji,” FPCODE: An efficient approach for multi-modal biometrics”, International Journal of Pattern Recognition and Artificial Intelligence, Vol.25, No.2 (2011), pp. 273-286.
[65] Kawulok M & Szymanek J, “Precise multi-level face detector for advanced analysis of facial images”, IET Image Process., , Vol.6, No.2, (2012), pp.95–103l.
[66] Salloum R & Kuo CCJ, “ECG-based biometrics using recurrent neural networks”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), (2017), pp.2062-2066.
[67] Raju, A S, and V Udayashankara, “Performance Evaluation of Multimodal Biometrics System”, International Journal of Pure and Applied Mathematics, Vol.118, No.5, (2018), pp.367-382.