A Review of Usability Methods and Metrics in Mobile Sport Application


  • Rahma Fitria
  • Mohd Faizal Zainul
  • Hanif .
  • Azham Hussain




Usability Method, Usability Metric, Mobile Sport


Sport activities are very important for personal health. It is claimed that regularly doing physical activity can increase the growth of personal health in term of intellect and psyche, psychological, and confidence. The growth of mobile phone technology can support and motivate people in doing exercise. The statistic shows people spent 52% of all time on digital media on mobile device. There are several factors affecting the usage of mobile application. One of them is the usable design. A technique name usability testing is designed to evaluate product in the user’s perspectives. It is conducted to improve the usability of existing application or to ensure the application being developed is usable. This paper aims to summarise the usability method and metric used to evaluate mobile sport application. Previous related studies are collected from Google Scholar, IEEE Xplore, ACM Digital Library, and Wiley Online Library to create this systematic review. Out of 512 previous studies, 43 are selected based on the criteria. The result shows experimental, questionnaires, and user experience test are the highest usability methods used for mobile sport application. Among these three methods, user experience test is the most method applied. In term of the usability metrics, effectiveness, efficiency, and satisfaction are the most metrics being measured in mobile sport application.





[1] W. H. Organization. (2016). “Obesity and overweight.â€

[2] S. Rudolph, (2015) “Mobile Aps Usage - Statistics and Trends [Infographic],â€.

[3] R. Asselin, G. Ortiz, J. Pui, A. Smailagic, and C. Kissling, “Implementation and Evaluation of the Personal Wellness Coach,†Distrib. Comput. Syst. Work. Int. Conf., vol. 5, (2005) 529–535.

[4] A. D. Cheok, Art and technology of entertainment computing and communication: Advances in interactive new media for entertainment computing. (2010).

[5] S.S. Nathan, N.L Hashim, A. Hussain, “A Usability Evaluation of Mobile Application: A Review on Usability Model For The Deaf†Jurnal Teknologi. vol. 78, no. 4-3, (2016) 127–131.

[6] B. Kitchenham and S. Charters, “Guidelines for performing Systematic Literature reviews in Software Engineering Version 2.3,†Engineering, vol. 45, no. 4ve, (2007) 1051.

[7] P. Pilloni, F. Mulas, L. Piredda, and S. Carta, “Assessing the User Experience Design as a Persuasive Methodology in a Real World Sport Application,†Proc. Int. Conf. Adv. Mob. Comput. Multimed. (MoMM ’13), (2013) 387–394.

[8] E. Haid, G. Kiechle, N. Göll, and M. Soutschek, “Evaluation of a Web-based and Mobile Ski Touring Application for GPS-enabled Smartphones,†Inf. Commun. Technol. Tour. 2008, no. July 2007,(2008) 313–323.

[9] Shakeel PM, Baskar S, Dhulipala VS, Mishra S, Jaber MM., “Maintaining security and privacy in health care system using learning based Deep-Q-Networksâ€, Journal of medical systems, 2018 Oct 1;42(10):186.https://doi.org/10.1007/s10916-018-1045-z

[10] P. Pilloni, F. Mulas, L. Piredda, and S. Carta, “How User Experience Design Can Affect Motivation : A Study on a Real World Sport Application,†Proc. 3rd Int. Conf. Soc. Eco-Informatics, no. c, (2013) 67–72.

[11] MuhammedShafi. P,Selvakumar.S*, Mohamed Shakeel.P, “An Efficient Optimal Fuzzy C Means (OFCM) Algorithm with Particle Swarm Optimization (PSO) To Analyze and Predict Crime Dataâ€, Journal of Advanced Research in Dynamic and Control Systems, Issue: 06,2018, Pages: 699-707

[12] A. Matassa and V. Manuguerra, “Designing a smart plantar to support people in sport activities,†(2015) 663–668.

[13] D. Metcalf, M. Milrad, D. Cheek, S. Raasch, and A. Hamilton, “My Sports Pulse: Increasing student interest in STEM disciplines through sports themes, games and mobile technologies,†Proc. - 5th IEEE Int. Conf. Wireless, Mobile, Ubiquitous Technol. Educ. WMUTE 2008, (2008) 23–30.

[14] X. Sun and A. May, “The role of spatial contextual factors in mobile personalization at large sports events,†Pers. Ubiquitous Comput., vol. 13, no. 4, (2009) 293–302.

[15] S. Kedah, “E- Service Quality , Ease of Use , Usability and Enjoyment as Antecedents of E-CRM Performance : An Empirical Investigation in Jordan Mobile Phone Services,†Technol. Manag., vol. 2, no. 2, (2009) 11–25.

[16] M. MAGUIRE, “Methods to support human-centred design,†Int. J. Hum. Comput. Stud., vol. 55, no. 4, (2001) 587–634.

[17] H. Malheiro, “Track It ! Enhancing GPS-Enabled Applications for Outdoor Sports and Activities.â€

[18] F. Mulas, S. Carta, P. Pilloni, and M. Manca, “Everywhere Run: a virtual personal trainer for supporting people in their running activity,†Proc. 8th Int. Conf. Adv. Comput. Entertain. Technol. - ACE ’11, p. Article 70, (2011).

[19] A. Nilsson, “Using IT to make place in space: evaluating mobile technology support for sport spectators,†ECIS 2004 Proc., (2004) 127.

[20] X. Sun and A. May, “Mobile personalization at large sports events user experience and mobile device personalization,â€.

[21] S. M. Arteaga, M. Kudeki, A. Woodworth, and S. Kurniawan, “Mobile system to motivate teenagers’ physical activity,†Proc. 9th Int. Conf. Interact. Des. Child., (2010) 1–10.

[22] U. Knebel, J. M. Leimeister, and H. Krcmar, “Personal mobile sports companion: Design and evaluation of it-supported product-servicebundles in the sports industry,†Proc. 15th Eur. Conf. Inf. Syst. ECIS 2007, (2007) 81–92.

[23] H. Suomela, “Scorekeeping with Smart Phones Mobile Solution for Outdoor Team Sports Tournaments Score- and Timekeeping Systems for Team Sports.â€

[24] M. Kranz, A. M??ller, N. Hammerla, S. Diewald, T. Pl??tz, P. Olivier, and L. Roalter, “The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices,†Pervasive Mob. Comput., vol. 9, no. 2, (2013) 203–215.

[25] Shakeel PM, Baskar S, Dhulipala VS, Jaber MM., “Cloud based framework for diagnosis of diabetes mellitus using K-means clusteringâ€, Health information science and systems, 2018 Dec 1;6(1):16.https://doi.org/10.1007/s13755-018-0054-0

[26] F. Buttussi, L. Chittaro, and D. Nadalutti, “Bringing mobile guides and fitness activities together: a solution based on an embodied virtual trainer,†Work, vol. Espoo Finl, (2006) 29–36.

[27] P. Centieiro, “Bringing the Sport Stadium Atmosphere to Remote Fans,†Proc. 21st ACM Int. Conf. Multimed., (2013) 1063–1066.

[28] L. Chittaro and F. Zuliani, “Exploring Audio Storytelling in Mobile Exergames to Affect the Perception of Physical Exercise,†Proc. ICTs Improv. Patients Rehabil. Res. Tech., (2013) 1–8.

[29] W. Choi, “Use of Mobile Wellness Applications and Perceptio n of Quality,†pp. 1–4.

[30] R. de Oliveira and N. Oliver, “TripleBeat: Enhancing Exercise Performance with Persuasion,†Proc. 10th Int. Conf. Hum. Comput. Interact. with Mob. Devices Ser (2008) 255–264.

[31] A. Fedosov, E. Niforatos, F. Alt, and I. Elhart, “Supporting interactivity on a ski lift,†Proc. 2015 ACM Int. Jt. Conf. Pervasive Ubiquitous Comput. Proc. 2015 ACM Int. Symp. Wearable Comput. - UbiComp ’15, (2015) 767–770.

[32] H. Ketabdar and M. Lyra, “System and methodology for using mobile phones in live remote monitoring of physical activities,†2010 IEEE Int. Symp. Technol. Soc., (2010) 350–356.

[33] M. Klein, A. Manzoor, A. Middelweerd, J. Mollee, and S. te Velde, “Encouraging physical activity via a personalized mobile system,†IEEE Internet Comput., vol. PP, no. 99, (2015) 1–1.

[34] Q. Liu, Z. Hua, C. Zang, X. Tong, and H. Lu, “Providing on-demand sports video to mobile devices,†Proc. 13th Annu. ACM Int. Conf. Multimed. - Multimed. ’05, no. 95, (2005) 347.

[35] A. Moller, L. Roalter, S. Diewald, J. Scherr, M. Kranz, N. Hammerla, P. Olivier, and T. Plotz, “GymSkill: A personal trainer for physical exercises,†2012 IEEE Int. Conf. Pervasive Comput. Commun. PerCom 2012, no. March, (2012) 213–220.

[36] A. Sahami Shirazi, M. Rohs, R. Schleicher, S. Kratz, A. Müller, and A. Schmidt, “Real-time nonverbal opinion sharing through mobile phones during sports events,†Proc. 2011 Annu. Conf. Hum. factors Comput. Syst. - CHI ’11, no. January 2016, (2011) 307.

[37] W. Song, D. W. Tjondronegoro, S.-H. Wang, and M. J. Docherty, “Impact of zooming and enhancing region of interests for optimizing user experience on mobile sports video,†Proc. Int. Conf. Multimed. - MM ’10, (2010) 321.

[38] D. Tjondronegoro, Y.-P. P. Chen, and A. Joly, “A scalable and extensible segment-event-object-based sports video retrieval system,†ACM Trans. Multimed. Comput. Commun. Appl., vol. 4, no. 2, (2008) 1–40.

[39] S. Van Dantzig, G. Geleijnse, and A. T. Van Halteren, “Toward a persuasive mobile application to reduce sedentary behavior,†Pers. Ubiquitous Comput., vol. 17, no. 6, (2013) 1237–1246.

[40] Selvakumar S, Inbarani H, Shakeel PM. A Hybrid Personalized Tag Recommendations for Social E-Learning System. International Journal of Control Theory and Applications. 2016;9(2):1187-99.

[41] H. Xu, X. Luo, and C. Liang, “Personalized sports video customization based on multi-modal analysis for mobile devices,†Proc. - Int. Conf. Electr. Control Eng. ICECE 2010, (2010) 4725–4730.

[42] C. Zang, Q. Liu, X. Tong, and H. Lu, “A framework for providing adaptive sports video to mobile devices,†Proc. 2nd Int. Conf. Mob. Multimed. Commun. - MobiMedia ’06, (2006) 1.

[43] F. R. Bentley and M. Groble, “TuVista: Meeting the Multimedia Needs of Mobile Sports Fans,†Proc. 17th ACM Int. Conf. Multimed., (2009) 471–480.

[44] A. Ahtinen and P. Huuskonen, “Let’s All Get Up and Walk to the North Pole : Design and Evaluation of a Mobile Wellness Application,†October, (2010) 3–12.

[45] P. F. Kugler, D. Schuldhaus, U. Jensen, and B. M. Eskofier, “Mobile Recording System for Sport Applications,†Proc. Int. Symp. Comput. Sci. Sport (IACSS 2011), no. April 2016, (2011) 67–70.

[46] A. Avci and S. Bosch, “Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: A survey,†{…} (ARCS), 2010 23rd {…}, (2010).

[47] R. de Oliveira and N. Oliver, “TripleBeat,†Proc. 10th Int. Conf. Hum. Comput. Interact. with Mob. devices Serv. - MobileHCI ’08, (2008) 255.

[48] F. Article, “A Mixed-Reality System for Broadcasting Mobile Devices,†Matrix, (2011) 72–84.

[49] Sridhar KP, Baskar S, Shakeel PM, Dhulipala VS., “Developing brain abnormality recognize system using multi-objective pattern producing neural networkâ€, Journal of Ambient Intelligence and Humanized Computing, 2018:1-9. https://doi.org/10.1007/s12652-018-1058-y

[50] P. F. Riley and J. C. Decker, “Analysis Architecture of a Mobile Sports Replay System,†(2006).

[51] A. Ahtinen, P. Huuskonen, and J. Häkkilä, “Let’s all get up and walk to the North Pole,†Proc. 6th Nord. Conf. Human-Computer Interact. Extending Boundaries - Nord. ’10, (2010) 3.

[52] K. Wan, X. Yan, and C. Xu, “Automatic mobile sports highlights,†IEEE Int. Conf. Multimed. Expo, ICME 2005, vol. 2005, (2005) 638–641.

[53] B. M. Eskofier, E. Hartmann, P. Kühner, J. Griffin, H. Schlarb, M. Schmitt, and J. Hornegger, “Real time surveying and monitoring of athletes using mobile phones and GPS,†Int. J. Comput. Sci. Sport., vol. 7, no. 1, (2008) 18–27.

View Full Article:

How to Cite

Fitria, R., Faizal Zainul, M., ., H., & Hussain, A. (2018). A Review of Usability Methods and Metrics in Mobile Sport Application. International Journal of Engineering & Technology, 7(3.20), 770–774. https://doi.org/10.14419/ijet.v7i3.20.27337
Received 2019-02-12
Accepted 2019-02-12