Dimensions and Sub-Dimensions for the Evaluation of M-Learning Apps for Children: A Review


  • Azham Hussain
  • Emmanuel O.C. Mkpojiogu
  • Fa’alina Hassan






Usability, Learning, Education, M-Apps, Children, Evaluation.


The introduction and rapid growth of mobile learning applications (m-learning apps) has improved the role of teachers in facilitating the learning process especially among children. The learning experiences of children are enhanced and enriched with the use of m-learning apps for children. There are several m-learning apps developed for children in the market today, however, some of these apps do not succinctly support and adequately assist in the learning process and educational endeavors and quest of these young minds. In this paper, a systematic review of literature was conducted to assess past research and studies on usability dimensions and sub-dimensions utilized in evaluating children’s m-learning apps. The systematic literature review consisted of the following approach: the definition of search strategy, selection of primary studies, data extraction, and implementation of synthesis strategy and lastly, the presentation of findings. The result of the review reveals that effectiveness, efficiency, learnability, and user satisfaction (with their corresponding sub-dimensions) were the top four usability dimensions used in the evaluation of m-learning apps for children. In addition, the works reviewed showed that usability evaluation is prominent only during the implementation phase of the applications’ development.




[1] R.A. Aderinoye, K.O. Ojokheta, and A.A. Olojede, “Integrating mobile learning into nomadic education programme in Nigeria: Issues and perspectives,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[2] R. Skiada, E. Soroniati, A. Gardeli, and D. Zissis, “EasyLexia: A mobile application for children with learning difficulties,†5th Int’l Conf. on Software Development & Technologies for Enhancing Accessibility & Fighting Info-exclusion, 2013.

[3] R. Albalawi, “Evaluating tangible user interface-based mobile-learning system for young children,†2013.

[4] A. Ali, M.A.O. Alrasheedi, and L. Fernando, “A study of the interface usability issues of mobile learning applications for smart phones from the user’s perspective,†Int’l J. on Integrating Technology in Education (IJITE), vol.3, no.4, Dec., 2014.

[5] B.A. Alsugair, G. Hopkins, T. Brailsford, and E. FitzGerald, “Does mobile technology support peer learning for Key Stage 3 children?†7th Int’l Conf. on Intelligent Environments, 2011.

[6] A. Alsumait, and A. Al-Osaimi, “Usability heuristics evaluation for child e-learning applications,â€. In Proc. of the 11th ACM Int’l Conf. on Information Integration and Web-based Applications & Services, pp. 425-430, Dec., 2009.

[7] J. Attewell, and C. Savill-Smith, “Mobile learning and social inclusion: focusing on learners and learning,â€. In Learning with Mobile Devices, Research and Development Conf. (mLearn), Rome, pp. 3-11, 2004.

[8] N.A.A. Aziz, “Children’s interaction with tablet applications: Gestures and interface design,†Int’l J. of Computer and Information Technology vol.2, no.3, May, 2013.

[9] C. Baber, M. Sharples, G. Vavoula, and P. Glew, “A learning space’ model to examine the suitability of different technologies for mobile learning,†Learning with mobile devices, vol.21, 2004.

[10] J.G. Caudill, “The growth of m-learning and the growth of mobile computing: Parallel developments,†The Int’l Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[11] X. Chen, C. Ragonesi, J.C. Galloway, and S.K. Agrawal, “Design of a robotic mobility system with a modular haptic feedback approach to promote socialization in children,†IEEE Transactions on Haptics, vol.7, no.2, April-June, 2014.

[12] T. Csata, “Evaluating non-functional requirements in mobile learning contents and multimedia educational software,†Learning with mobile devices, vol.13, 2004.

[13] P. Dawabi, M. Wessner, and E. Neuhold, “Using mobile devices for the classroom of the future,†Learning with mobile devices, vol.55, 2004.

[14] P. David, R. Hokyoung, and C. Mark, “A Design Requirements Framework for Mobile Learning Environments,†J. of Computers, 2(4), 2007.

[15] S. Keele, “Guidelines for performing systematic literature reviews in software engineering,†Technical report, EBSE Technical Report EBSE-2007-01: 1-57, 2007.

[16] J. Nielsen, “Usability Engineering,†Boston MA. Acad. Press, 1993.

[17] ISO IEC 9126-1:2001. “Software Engineering-Product Quality Part 1-Quality Model,†2001.

[18] C. Salvador, A. Nakasone, and J. Antonio, “A systematic review of usability techniques in agile methodologies. IEEE

[19] A. Druin, “Mobile technology for children designing for interaction and learning,†Morgan Kaufmann, 2009.

[20] A. Hussain, E.O.C. Mkpojiogu, and Z. Hussain, “Usability evaluation of a web-based health awareness portal on smart phone devices using ISO 9241-11 model,†Jurnal Teknologi, vol.77, no.4, pp. 1-5, 2015.

[21] A. Hussain, and E.O.C. Mkpojiogu, “An application of ISO/IEC 25010 standard in the quality-in-use assessment of an online health awareness system,†Jurnal Teknologi, vol.77, no.5, pp.9-13, 2015.

[22] A. Hussain, and E.O.C. Mkpojiogu, “The effect of responsive web design on the user experience with laptop and smart phone devices,†Jurnal Teknologi, vol.77, no.4, pp.41-47, 2015..

[23] S. Thomas, G. Schott, and M. Kambouri, “Designing for learning or designing for fun? Setting usability guidelines for mobile educational games,†Learning with mobile devices, pp.173, 2004.

[24] S. Wood, and P. Romero, “User-centred design for a mobile learning application,†Proceedings of the 3rd Mexican. Workshop on Human Computer Interaction (MexIHC'2010), 2010.

[25] R. Zhang, “Using Mobile Phones to Assist Children’s Learning in Universeum,†2009..

[26] M.J.J. Edith, C.B. Eduardo, and B.B.C. Eval, “Tool for experimenting with concepts of mobile robotics as applied to children’s education,†IEEE Transactions on Education, vol.53, no.1, Feb., 2010.

[27] P.B. Muyinda, E. Mugisa, and K. Lynch, “M-learning: The educational use of mobile communication devices,†Strengthening the Role of ICT in Development, vol.72, 2007.

[28] A. Kukulska-Hulme, and J. Traxler, (Eds.), “Mobile learning: A handbook for educators and trainers,†Psychology Press, 2005.

[29] B. Parhizkar, W.A.K. Obeidy, S.A. Chowdhury, Z.M. Gebril, M.N. Ah Ngan, and A.H. Lashkari, “Android mobile augmented reality application based on different learning theories for primary school children,†IEEE, 2012.

[30] E.O.C. Mkpojiogu, N.L. Hashim, and R. Adamu, R. “Observed demographic differentials in user perceived satisfaction on the usability of mobile banking applications,†8th Knowledge Management International Conference (KMICe’16), Chiang Mai, Thailand, 29-30 August, 2016.

[31] A. Hussain, and E.O.C. Mkpojiogu, “Usability evaluation techniques in mobile commerce applications: a systematic review,†International Conference on Applied Science and Technology (ICAST’16), Kedah, Malaysia. AIP Conf. Proc., vol.1761, no.1, 2016.

[32] A. Hussain, and E.O.C. Mkpojiogu, “A systematic review of usability test metrics for mobile video streaming apps,†International Conference on Applied Science and Technology (ICAST’16), Kedah, Malaysia, AIP Conf. Proc., vol.1761, no.1, 2016.

[33] A. Druin, G. Knell, E. Soloway, D. Russell, E. Mynett, and Y. Rogers, “The future of child-computer interaction,†CHI 2011, May 7–12, 2011, Vancouver, BC, Canada, 2011. ACM 978-1-4503-0268-5/11/05.

[34] H. Edwards, and R. Benedyk, “A comparison of usability evaluation methods for child participants in a school setting,†In Proceedings of the 6th international conference on Interaction design and children pp. 9-16, 2007. ACM.

[35] L. Hanna, K. Risden, and K. Alexander, “Guidelines for usability testing with children,†Interactions, vol.4, no. 5, pp. 9-14, 1997.

[36] R. Harrison, D. Flood, and D. Duce, “Usability of mobile applications: literature review and rationale for a new usability model,†Journal of Interaction Science, vol.1, no.1, pp. 1-16, 2013.

[37] A.S. Hashim, W.F. Wan Ahmad, and R. Ahmad, “Mobile learning course content application as a revision tool: The eEffectiveness and usability,†International Conference on Pattern Analysis and Intelligent Robotics 28-29 June, 2011, Putrajaya, Malaysia

[38] J. He, J. Ren, G. Zhu1, S. Cai, and G. Chen, “Mobile-based AR application helps to promote EFL children’s vocabulary study,†IEEE 14th International Conference on Advanced Learning Technologies, 2014.

[39] J. Kadirire, “Instant messaging for creating interactive and collaborative m-learning environments,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[40] M. Kam, A. Agarwal, A. Kumar, S. Lal, A. Mathur, A. Tewari, and J. Canny, “Designing e-learning games for rural children in India: A format for balancing learning with fun,†2008.

[41] S. Kanala, T. Nousiainen, and M. Kankaanranta, “Using a mobile application to support children’s writing motivation,†Interactive Technology and Smart Education, vol.10, no.1, pp.4 – 14, 2013.

[42] A. Kukulska-Hulme, “Mobile usability in educational contexts: what have we learnt?†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[43] K. Peters, “M-learning: Positioning educators for a mobile, connected future,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[44] L. Qvortrup, “Knowledge, education and learning, e-learning in the knowledge society,†Sam Funds Literature, 2006.

[45] P. Rainger, “Usability and accessibility of personal digital assistants as assistive technologies in education,†Learning with mobile devices, 2004.

[46] T. Rekkedal, and A. Dye, “Mobile Distance Learning with PDAs: Development and testing of pedagogical and system solutions supporting mobile distance learners,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[47] Y.E. Shih, “Setting the new standard with mobile computing in online learning,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[48] R. Skiada, E. Soroniati, A. Gardeli, and D. Zissis, “EasyLexia: A mobile application for children with learning difficulties,†5th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, DSAI, 2013.

[49] A. Stone, and K.U. Thames, “Designing scalable, effective mobile learning for multiple technologies,†Learning with mobile devices, 2004.

[50] R. Tahir, F. Arif, “Framework for evaluating the usability of mobile educational applications for children,†The International Journal of E-Learning and Educational Technologies in the Digital Media (IJEETDM) 1(1): 16-31The Society of Digital Information and Wireless Communication (SDIWC), 2014.

[51] J. Traxler, “Defining, discussing and evaluating mobile learning: The moving finger writes and having writ,†The International Review of Research in Open and Distributed Learning, vol.8, no.2, 2007.

[52] N.A. Wahab, A. Osman, and M.H. Ismail, “Engaging children to science subject: A heuristic evaluation of mobile learning prototype,†Second International Conference on Computer Engineering and Applications, 2010

[53] N.S. Yahaya, and S.N. Abdul Salam, “ Mobile Learning Application For Children: Belajar Bersama Dino. The International Conference On Communication and Media 2014 (I-COME’14), 18-20 October 2014, Langkawi, Malaysia

View Full Article: