A Survey on Computer based Deception Detection Techniques

  • Authors

    • Sabu George
    • Manohara Pai M.M
    • Radhika M Pai
    2018-11-27
    https://doi.org/10.14419/ijet.v7i4.17.21796
  • Deception detection, CIT, GKT, EEG, brain fingerprint, micro-expression, emotional stress.

  • Deception detection plays a great role in the criminology field and it is a challenge for investigators and researchers for identifying real liar from normal behavior. There is different methods available based on brain, face, voice, etc. each has its own advantages and disadvantages.  Most of the lie detection methods are based on the variation of skin resistance, respiratory rate (breath rate), heart beat rate, etc. by the physical contact of some sensors or equipment fixed on the body of the subject. These types of deception detection methods are obtrusive.  In case of non-contact deception detection methods there are no sensor used on the body of the subject and the testing is done without the knowledge of the subject being tested. This paper gives a review on all these deception detection techniques.

     

     

  • References

    1. [1] Madeline Smith, Jeffrey Hancock, Lindsay Reynolds, and Jeremy Birnholtz, “Everyday deception or a few prolific liars? the prevalence of lies in text messaging†Computers in Human Behavior, vol. 41, no. 3, pp. 220–227, 2014.

      [2] Xiang Yu, Shaoting Zhang, Zhennan Yan, Fei Yang, Junzhou Huang, Norah E. Dunbar, Matthew L. Jensen, Judee K. Burgoon, and Dimitris N. Metaxas, “Is Interactional Dissynchrony a Clue to Deception? Insights from Automated Analysis of Nonverbal Visual Cuesâ€, IEEE Transactions on Cybernetics, Vol. 45, No. 3, pp. 492-506, 2015.

      [3] Mohamed Abouelenien, Veronica Perez-Rosas, Rada Mihalcea, and Mihai Burzo, “Deception detection using a multimodal approach†In Proceedings of the 16th International Conference on Multimodal Interaction, New York, NY, USA. ACM, pp. 58–65, 2014.

      [4] Masip J, “Deception detection: State of the art and future prospectsâ€, Psicothema, Vol.29, No. 2, pp.149-159, 2017.

      [5] Vrij, A., Leal, S., Mann, S., Vernham, Z., & Brankaert, F., “Translating theory into practice: Evaluating a cognitive lie detection training workshopâ€, Journal of Applied Research in Memory and Cognition, Vol. 4, No. 1, pp. 110-120, 2015.

      [6] Mohamed Abouelenien, Verónica Pérez-Rosas, Bohan Zhao, Rada Mihalcea and Mihai Burzo,“Gender-based Multimodal Deception Detectionâ€, Proceedings of the Symposium on Applied Computing, Marrakech, Morocco, April 03 - 07, 2017, ACM, New York, NY, USA, pp. 137-144, 2017.

      [7] Mircea Zloteanu, “Emotions and Deception Detectionâ€, Ph.D. Thesis, Psychology and Language Sciences, University College London, UK, 2016.

      [8] Wu, Z., Singh, B., Davis, L.S., Subrahmanian, V, “Deception detection in videosâ€, Association for the Advancement of Artificial Intelligence, 2017.

      [9] Jackie Hillman, Aldert Vrij, and Samantha Mann, “Um they were wearing : The effect of deception on specific hand gesturesâ€. Legal and Criminological Psychology, Vol. 17, No. 2, pp. 336–345, 2012.

      [10] Gautam Krishna , Chavali Sai Kumar N V , Bhavaraju Tushal , Adusumilli Venu Gopal , Puripanda, “Micro-Expression Extraction For Lie Detection Using Eulerian Video (Motion and Color) Magnificationâ€, Master Thesis, Department of Applied Signal Processing Blekinge Institute of Technology; Karlskrona, Sweden, 2015.

      [11] Porter, S., Brinke, L., Baker, and Wallace, B. (2011). Would I lie to you?“Leakage†in deceptive facial expressions relates to psychopathy and emotional intelligence. Personality and Individual, Vol. 2, No.51, pp. 133–137, 2011.

      [12] MatthiasGamer, YoniPertzov, “Detecting Concealed Information and Deception Recent Developmentsâ€, Academic Press, 169-186, 2018.

      [13] Frank M. Marchak, “Detecting false intent using eye blink measuresâ€, Frontiers in Psychology, Vol.4, Article. 736, pp. 1-9, 2013.

      [14] Su, L., and Levine, M. “Does lie to me lie to you? an evaluation of facial clues to high-stakes deceptionâ€. Computer Vision and Image Understanding, Vol. 147, No.2, pp.52–68, 2016.

      [15] Sabu George, Manohara Pai M.M., Radhika M Pai and Samir Kumar Praharaj “Eye Blink Count and Eye Blink Duration Analysis for Deception Detectionâ€, IEEE ICACCI, Sixth International Conference on Advances in Computing, Communications and Informatics, Sep. 13 - 16, 2017, Manipal, pp 224-229, 2017.

      [16] Savita Sondhi, Ritu Vijay, Munna Khan and Ashok K. Salhan, “Voice Analysis for Detection of Deceptionâ€, 11th International Conference on Knowledge, Information and Creativity Support Systems (KICSS), Yogyakarta, Indonesia, 10-12 Nov. 2016.

      [17] Nidhi Srivastava , Sipi Dubey, “Deception detection using artificial neural network and support vector machineâ€, Biomedical Research 2018, Vol. 29, No. 10, pp. 2044-2048, 2018.

      [18] Dominik R.Bach, SamuelGerster, AthinaTzovara and GiuseppeCastegnetti, “A linear model for event-related respiration responsesâ€, Journal of Neuroscience Methods, Vol. 270, No.2, pp. 147–155, 2016.

      [19] Rumeysa Cakmak and Akram M. Zeki, “Neuro Signal Based Lie Detectionâ€, 2015 IEEE International Symposium on Robotics and Intelligent Sensors (IEEE IRIS20I5), 18-20 Oct. 2015, Langkawi, Malaysia, 2015.

      [20] Artha Ivonita Simbolon, Arjon Turnip, Jeperson Hutahaean, Yessica Siagian and Novica Irawati, “An Experiment of Lie Detection based EEG-P300 Classified by SVM Algorithmâ€, 2015 International Conference on Automation, Cognitive Science, Optics, Micro Electro-Mechanical System, and Information Technology (ICACOMIT), Bandung, Indonesia, October 29–30, 2015.

      [21] Arjon Turnip and Artha Ivonita, “Online Brain Activity Extraction from EEGP300 Signals with Nonlinear Autoregressive Modelâ€, Internet-working Indonesia Journal, vol.8, no.1, pp. 35-39, 2016.

      [22] Jiwei Li, Myle Ott, Claire Cardie, and Eduard Hovy, “Towards a general rule for identifying deceptive opinion spamâ€, In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, Maryland, 2014.

      [23] Vrij, A., and Fisher, R., “Which lie detection tools are ready for use in the criminal justice system?†Journal of Research in Memory and Cognition, Vol. 5, No. 2, pp. 302-307, 2016.

      [24] Grubin, D., & Madsen, L., “Lie detection and the polygraph: A historical reviewâ€. The Journal of Forensic Psychiatry & Psychology, vol. 16, no. 2, 357-369, 2005.

      [25] John Synnott, David Dietzel and Maria Ioannou, “A review of the polygraph: history, methodology and current statusâ€, Crime Psychology Review, vol. 1, no. 1, pp. 59–83, 2015.

      [26] Meijer, E. H., & Verschuere, B., “The polygraph: Current practice and new approachesâ€, Detecting deception: Current challenges and cognitive approaches, Chichester, UK: Willey, pp. 59-80, 2015.

      [27] Bruno Verschuere, Ewout H Meijer, “What's on Your Mind? Recent Advances in Memory Detection Using the Concealed Information Testâ€, European Psychologist, Vol. 19, No. 3, pp. 162-171, 2015.

      [28] Bruno Verschuere, Ewout Meijer and Armand De Clercq, “Concealed information under stress: A test of the orienting theory in realâ€life police interrogationsâ€, Legal and Criminological Psychology, vol. 16, no. 2, pp. 348-356, 2011.

      [29] George Visu-Petra, Miclea, M., Visu-Petra, L. “Reaction time-based detection of concealed information in relation to individual differences in executive functioningâ€. Applied Cognitive Psychology, Vol. 26, pp.342–351, 2012.

      [30] George Visu-Petra, Mihai Varga, Mircea Miclea, and Laura Visu-Petra, “When Interference Helps: Increasing Executive Load to Facilitate Deception Detection in the Concealed Information Testâ€, Frontiers in Psychology, vol. 4, no. 146, pp. 1-11, 2013.

      [31] Lin Su, Martin D. Levine, “High-Stakes Deception Detection Based on Facial Expressionsâ€, 22nd International Conference on Pattern Recognition (ICPR), Stockholm, Sweden, 24-28 Aug. 2014.

      [32] Xiang Yu, S. Zhang, Zhennan Yan, Fei Yang, Junzhou Huang, Norah E. Dunbar, Matthew L. Jensen, Judee K. Burgoon, and D. N. Metaxas, “Is Interactional Dissynchrony a Clue to Deception? Insights from Automated Analysis of Nonverbal Visual Cuesâ€, IEEE Transactions on Cybernetics, Vol. 45, No. 3, pp. 492-506, 2015.

      [33] Sarah D. Gunnery, Judith A. Hall, Mollie A. Ruben, “The Deliberate Duchenne Smile: Individual Differences in Expressive Controlâ€, Journal of Nonverbal Behavior, Vol. 37, No. 1, pp. 29-41, 2012.

      [34] Moi Hoon Yap, Hassan Ugail and Reyer Zwiggelaar, “Facial Behavioral Analysis: A Case Study in Deception Detection†British Journal of Applied Science & Technology, Vol. 4, No. 10, pp: 1485-1496, 2014.

      [35] Senya Polikovsky, Yoshinari Kameda and Yuichi Ohta, “Facial Micro-Expression Detection in Hi-Speed Video Based on Facial Action Coding System (FACS)â€, IEICE Transactions, vol. E96-D, no.1, pp. 81-92, 2013.

      [36] Michel Owayjan, Ahmad Kashour, Nancy Al Haddad, Maurice Fadel, and Ghinwa Al Souki. “The design and development of a lie detection system using facial micro-expressionsâ€. 2nd International Conference on Advances in Computational Tools for Engineering Applications, 12-15 Dec. 2012, pp. 33–38, 2012.

      [37] W.-J. Yan, Q. Wu, Y.-J. Liu, S.-J. Wang, and X. Fu, “CASME database: A Dataset of Spontaneous Micro-expressions Collected from Neutralized Facesâ€, FG. IEEE, pp. 1–7, 2013.

      [38] Kyosuke Fukuda, “Eye blinks: new indices for the detection of deceptionâ€, International Journal of Psychophysiology, Vol.40, pp. 239-245, 2001.

      [39] Thonney J, Kanachi M, Sasaki H, Hatayama T “Eye blinking as a lie detection index in an emotionally arousing context.†Tohoku Psychologica Folia 64:58-67, 2005.

      [40] Travis L. Seymour, Christopher A. Baker and JoshuaT. Gaunt, “Combining blink, pupil, and response time measures in a concealed knowledge testâ€, Frontiers in Psychology, Vol. 3, No. 614, pp. 1-15, 2013.

      [41] Sharon Leal, Aldert Vrij, “Blinking During and After Lyingâ€, Journal of Nonverbal Behaviour, Vol. 32, pp. 187-194, 2008.

      [42] Leal S, Vrij A , “Blinking during and after lyingâ€. Journal of Nonverbal Behaviour, vol. 32, no.2, pp. 187-194, 2008.

      [43] Mann S, Vrij A, Bull R, “Suspects, lies, and videotape: an analysis of authentic high-stake liarsâ€, Law Human Behavior, vo. 26, no.4, pp. 365-376, 2002.

      [44] Frank M. Marchak, “Detecting false intent using eye blink measuresâ€, Frontiers in Psychology , Vol. 4, No. 736, pp. 1-9, 2013.

      [45] Brandon S. Perelman, “Detecting deception via eyeblink frequency modulationâ€, PeerJ Vol. 2 No. e260, pp. 1-12, 2015.

      [46] Kevin K.Park, Hye Won Suk, Heung sun Hwang and Jang-HanLee, “A functional analysis of deception detection of a mock crime using infrared thermal imaging and the Concealed Information Testâ€, Frontiers in Human Neuroscience, vol. 7, no. 70, pp. 1-17, 2013.

      [47] Bashar A. Rajoub and Reyer Zwiggelaar, “Thermal Facial Analysis for Deception Detectionâ€, IEEE Transactions on Information Forensics and Security, vol. 9, no. 6, 2015.

      [48] Mohamed Abouelenien, Rada Mihalcea and Mihai Burzo, “Analyzing Thermal and Visual Clues of Deception for a Non-Contact Deception Detection Approachâ€, “Proceedings of the 9th ACM International Conference on PErvasive Technologies related to Assistive Environments, Corfu, Island, Greece June 29 - July 01, 2016

      [49] Buccino AP, Keles HO, Omurtag A, “Hybrid EEG-fNIRS Asynchronous Brain-Computer Interface for Multiple Motor Tasksâ€, PLoS ONE, vol. 11, no.1, pp. 1-16, 2016.

      [50] P. Bhuvaneswari and J. Satheesh Kumar, “Influence of Linear Features in Nonlinear EEG Signalsâ€, Procedia Computer Science. vol. 47, no. 1, pp. 229-236, 2015.

      [51] H Wang , W Chang and Chi Zhang, “Functional brain network and multichannel analysis for the P300-based brain computer interface system of lying detectionâ€, Expert Systems with Applications, vol. 53, no. 2, pp. 117-128, 2015.

      [52] Rumeysa Cakmak and Akram M. Zeki, “Determining the state of truthfulness and falsehood by analyzing the acquired EEG signalsâ€, IEEE 12th International Colloquium on Signal Processing & Its Applications (CSPA), Malacca City, Malaysia, 4-6 March 2016.

      [53] D Wang, Duoqian Miao, and Gunnar Blohm, “A New Method for EEG-Based Concealed Information Testâ€, IEEE Transactions on Information Forensics and Security, vol. 8, no. 3, pp. 520-527, 2013.

      [54] Anna Caterina Merzagora, Scott Bunce, Meltem Izzetoglu and Banu Onaral, “Wavelet analysis for EEG feature extraction in deception detectionâ€, Proceedings of the 28th IEEE EMBS Annual International Conference, New York City, USA, Aug 30-Sept 3, 2006.

      [55] Vahid Abootalebi, M Hassan Moradi and Mohammad Ali Khalilzadeh, “A new approach for EEG feature extraction in P300-based lie detectionâ€, Computer Methods and Programs in Biomedicine , vol. 94, no. 2, pp. 48–57, 2009.

      [56] Artha Ivonita Simbolon, Arjon Turnip, Jeperson Hutahaean, Yessica Siagian and Novica Irawati, “An experiment of lie detection based EEG-P300 classified by SVM algorithmâ€, International Conference on Automation, Cognitive Science, Optics, Micro Electro-MechanicalSystem, and Information Technology, Bandung, Indonesia, 29-30 Oct. 2015.

      [57] Syed Kamran H, Malik I Daud, Aimin Jiang and Zubair Khan, “Evaluation of P300 based Lie Detection Algorithmâ€, Electrical and Electronic Engineering, vol. 7, no – 3, pp. 69-76, 2017.

      [58] Lawrence A. Farwell, Drew C. Richardson and Graham M. Richardson, “Brain fingerprinting field studies comparing P300-MERMER and P300 brainwave responses in the detection of concealed information†Cogn Neurodyn., Vol. 7, No.4, pp. 263-99, 2012.

      [59] Martha J. Farah, J. Benjamin Hutchinson, E A. Phelps and Anthony D. Wagner, “Functional MRI-based lie detection: scientific and societal challengesâ€, Neuroscience and The Law Science and Society, vol. 14, no. 2, pp. 123-131, 2015.

      [60] Tatia M. C. Lee, Tiffany M. Y. Lee, ARaine and Chetwyn C. H. Chan, “Lying about the Valence of Affective Pictures: An fMRI Studyâ€, PLoS ONE, vol. 5, no. 8, pp. 1-10, 2010.

      [61] V. Rodellar-Biarge, D. Palacios-Alonso, V. Nieto-Lluis and P. Gómez-Vilda, “Analysis of emotional stress in voice for deception detectionâ€, 2015 International Work Conference on Bio-inspired Intelligence (IWOBI), pp. 127-132, 2015.

  • Downloads

  • How to Cite

    George, S., Pai M.M, M., & M Pai, R. (2018). A Survey on Computer based Deception Detection Techniques. International Journal of Engineering & Technology, 7(4.17), 14-21. https://doi.org/10.14419/ijet.v7i4.17.21796