English Alphabet Tutorial Using Kinect for Person with ASD
Keywords:Autism Spectrum Disorder, Attention span, Kinect, Pervasive Developmental Disorder, Interactive.
People diagnose with Autism Spectrum Disorder (ASD) is under the group called Pervasive Developmental Disorder (PDD). Students with ASD tend to have problems with familiarization of alphabets for the reason that they tend to lose focus in a short span of time. Thus, the proponents developed an interactive tutorial in alphabet familiarization. The tutorial is a program developed in software called Visual Studio. A device called Kinect enables the user to interact with the program using hand gestures. Several processes is executed in the program which are capturing of hand gestures, segmentation of the hand from the body, isolation of the finger tip from the hand, recognition of the finger gesture, and lastly comparison of the input gesture to the plotted points. The extensive experiments and testing demonstrates that our tutorial program can recognize the gestured letters with 95.24% accuracy for capital letters and 98.56% for small letters. Also, it can interpret the input gestures with an average execution time of 15.62 milliseconds for both capital and small letters.
 The medlineplus website: [Online]. Available: https://medlineplus.gov/autismspectrumdisorder.html
 The medicinenet website: [Online]. Available: https://www.medicinenet.com/pervasive_development_disorders/article.htm
 The sociallyspeakingllc website: [Online]. Available: http://sociallyspeakingllc.com/my-mission-for-socially/free-pdfs/understanding_behavioral.pdf
 J.Wood and B. McLemore (2009). Critical Components in Early Literacy â€“ Knowledge of the Alphabet and Phonics Instruction. The Florida Reading Quarterly â€” Vol. 38, No. 2, December 2001
 Raising Children Network. â€œPaying attention: children with autism spectrum disorder (ASD)â€ Retrieved March 11,2017 from http://raisingchildren.net.au/articles/autism_spectrum_disorder_play.html
 C. Holzberg (2008), â€œTechnology in Special Educationâ€. Retrieved January 20, 2017 from https://www.questia.com/magazine/1G1-15377816/technology-in-special-education
 F. Espique, Ph.D., â€œIntegrating Computer Technology in Handling Students with Special Learning Needsâ€ Retrieved January 20, 2017 from http://www.fit-ed.org/congress2008/contents/ESPIQUE/Espique%20PAPER.pdf
 E. Boutsika (2014), â€œKinect in Education: A Proposal for Children with Autismâ€ Retrieved January 20, 2017 from https://ac.els-cdn.com/S1877050914000179/1-s2.0-S1877050914000179-main.pdf?_tid=7e8eda1c-f626-11e7-bd1d-00000aacb360&acdnat=1515603265_8fb0459f55bfc9a23edc8f26c9c38638
 T. Hongyong, and Y. Youling (2012), â€œFinger Tracking and Gesture Interaction with Kinectâ€ Retrieved March 11, 2017 from ieeexplore.ieee.org/document/6391901/
 K. Byron, L. Pham, and J. Situka (2014), â€œMarker-less Motion Trackingâ€ Retrieved January 10, 2017 from www.vrac.iastate.edu/wp-content/uploads/.../Markerless_Motion_Tracking_paper.pdf
 Z. Feng, S. Xu, X. Zhang, et. al. (2012), â€œReal-time Fingertip Tracking and Detection using Kinect Depth Sensor for a New Writing-in-the Air System from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.925.8088&rep=rep1&type=pdf
 M. Bakar, R. Samad, D. Pebrianti, M. Mustafa, and N. Abdullah (2015), â€œFinger Application Using K-Curvature Method and Kinect Sensor in Real-Timeâ€ from ieeexplore.ieee.org/document/7359032/
 Arun Kulshreshth, Chr is Zorn, and Joseph J. LaViola Jr (2013), â€œPoster: Real-time Markerless Kinect based Finger Tracking and Hand Gesture Recognition for HCIâ€ from ieeexplore.ieee.org/document/6550241/
 Z. Ye (2013), â€œFinger writing in the air system using kinect sensorâ€ from ieeexplore.ieee.org/document/6618236
 Y. Chen, B. Luo, Y. Chen, G. Liang, and X. Wu (2015), â€œA Real-Time Dynamic Hand Gesture Recognition System Using Kinect Sensorâ€ from ieeexplore.ieee.org/document/7419071/
View Full Article:
How to Cite
LicenseAuthors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under aÂ Creative Commons Attribution Licensethat allows others to share the work with an acknowledgement of the work''s authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal''s published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (SeeÂ The Effect of Open Access).