English Alphabet Tutorial Using Kinect for Person with ASD

  • Authors

    • Ana Antoniette C. Illahi
    • . .
    2018-11-27
    https://doi.org/10.14419/ijet.v7i4.16.21781
  • Autism Spectrum Disorder, Attention span, Kinect, Pervasive Developmental Disorder, Interactive.

  • People diagnose with Autism Spectrum Disorder (ASD) is under the group called Pervasive Developmental Disorder (PDD). Students with ASD tend to have problems with familiarization of alphabets for the reason that they tend to lose focus in a short span of time. Thus, the proponents developed an interactive tutorial in alphabet familiarization. The tutorial is a program developed in software called Visual Studio. A device called Kinect enables the user to interact with the program using hand gestures. Several processes is executed in the program which are capturing of hand gestures, segmentation of the hand from the body, isolation of the finger tip from the hand, recognition of the finger gesture, and lastly comparison of the input gesture to the plotted points. The extensive experiments and testing demonstrates that our tutorial program can recognize the gestured letters with 95.24% accuracy for capital letters and 98.56% for small letters. Also, it can interpret the input gestures with an average execution time of 15.62 milliseconds for both capital and small letters.

     

     

  • References

    1. [1] The medlineplus website: [Online]. Available: https://medlineplus.gov/autismspectrumdisorder.html

      [2] The medicinenet website: [Online]. Available: https://www.medicinenet.com/pervasive_development_disorders/article.htm

      [3] The sociallyspeakingllc website: [Online]. Available: http://sociallyspeakingllc.com/my-mission-for-socially/free-pdfs/understanding_behavioral.pdf

      [4] J.Wood and B. McLemore (2009). Critical Components in Early Literacy – Knowledge of the Alphabet and Phonics Instruction. The Florida Reading Quarterly — Vol. 38, No. 2, December 2001

      [5] Raising Children Network. “Paying attention: children with autism spectrum disorder (ASD)†Retrieved March 11,2017 from http://raisingchildren.net.au/articles/autism_spectrum_disorder_play.html

      [6] C. Holzberg (2008), “Technology in Special Educationâ€. Retrieved January 20, 2017 from https://www.questia.com/magazine/1G1-15377816/technology-in-special-education

      [7] F. Espique, Ph.D., “Integrating Computer Technology in Handling Students with Special Learning Needs†Retrieved January 20, 2017 from http://www.fit-ed.org/congress2008/contents/ESPIQUE/Espique%20PAPER.pdf

      [8] E. Boutsika (2014), “Kinect in Education: A Proposal for Children with Autism†Retrieved January 20, 2017 from https://ac.els-cdn.com/S1877050914000179/1-s2.0-S1877050914000179-main.pdf?_tid=7e8eda1c-f626-11e7-bd1d-00000aacb360&acdnat=1515603265_8fb0459f55bfc9a23edc8f26c9c38638

      [9] T. Hongyong, and Y. Youling (2012), “Finger Tracking and Gesture Interaction with Kinect†Retrieved March 11, 2017 from ieeexplore.ieee.org/document/6391901/

      [10] K. Byron, L. Pham, and J. Situka (2014), “Marker-less Motion Tracking†Retrieved January 10, 2017 from www.vrac.iastate.edu/wp-content/uploads/.../Markerless_Motion_Tracking_paper.pdf

      [11] Z. Feng, S. Xu, X. Zhang, et. al. (2012), “Real-time Fingertip Tracking and Detection using Kinect Depth Sensor for a New Writing-in-the Air System from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.925.8088&rep=rep1&type=pdf

      [12] M. Bakar, R. Samad, D. Pebrianti, M. Mustafa, and N. Abdullah (2015), “Finger Application Using K-Curvature Method and Kinect Sensor in Real-Time†from ieeexplore.ieee.org/document/7359032/

      [13] Arun Kulshreshth, Chr is Zorn, and Joseph J. LaViola Jr (2013), “Poster: Real-time Markerless Kinect based Finger Tracking and Hand Gesture Recognition for HCI†from ieeexplore.ieee.org/document/6550241/

      [14] Z. Ye (2013), “Finger writing in the air system using kinect sensor†from ieeexplore.ieee.org/document/6618236

      [15] Y. Chen, B. Luo, Y. Chen, G. Liang, and X. Wu (2015), “A Real-Time Dynamic Hand Gesture Recognition System Using Kinect Sensor†from ieeexplore.ieee.org/document/7419071/

  • Downloads

  • How to Cite

    Antoniette C. Illahi, A., & ., . (2018). English Alphabet Tutorial Using Kinect for Person with ASD. International Journal of Engineering & Technology, 7(4.16), 66-70. https://doi.org/10.14419/ijet.v7i4.16.21781