Ilung: Interactive Holographic Medical Application for Lung CT Scans Using Hololens
About this article
DOI:
https://doi.org/10.14419/ijet.v7i4.31.23720Keywords:
Hologram, CT scans, Microsoft HoloLens, Medical Application, 3D modeling.Abstract
This research aims to design a holographic medical application for lung CT scans using Microsoft HoloLens. iLung application offers users the possibility to interact with the actual lung of a patient in a mixed reality and 3D environment. A prototype of the iLung was developed based on raw CT scans data and converted into 3D model generation. This paper reports the earlier stage in designing the application. Based on the application’s overview with a group of users, the findings gathered showed that iLung prototype facilitates interactive manipulation and exploring of the 3D lung object. Feedback and comments were recorded for future improvements such as air taping interaction method and voice command.
References
Yang, Jinzhong; Sharp, Greg; Veeraraghavan, Harini ; van Elmpt, Wouter ; Dekker, Andre; Lustberg, Tim; Gooding, Mark, Data from Lung CT Segmentation Challenge, The Cancer Imaging Archive. (2017). http://doi.org/10.7937/K9/TCIA.2017.3r3fvz08
Clark K, Vendt B , Smith K , Freymann J, Kirby J, Koppel P, Moore P, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F, “The Cancer Imaging Archive (TCIA): Maintaining and Operating a Pub-lic Information Repository” Journal of Digital Imaging, Vol.26, Nom.6, (2013), pp:1045-1057.
Wang W, Wu X, Chen G, & Chen Z, “Holo3DGIS: Leveraging Microsoft HoloLens in 3D Geographic Information” ISPRS Interna-tional Journal of Geo-Information, Vol. 7, Nom. 2, (2018), doi:10.3390/ijgi7020060
Chandar K, & Satyasavithri T, “Segmentation and 3D Visualiza-tion of Pelvic Bone from CT Scan Images” IEEE 6th International Conference on Advanced Computing (IACC), (2016), pp:430-433, doi:10.1109/iacc.2016.86
Trabelsi N, Aloui K, & Sellem DB, “3D active shape model for CT-scan liver segmentation”, International Conference on Infor-mation and Digital Technologies (IDT), (2017). doi:10.1109/dt.2017.8012093
View more references (10)
Domínguez GM, Hernández C, Ruisoto P, Juanes AJ, Prats A, & Hernández A, “Application of the 3D slicer software in the study of the brains ventricular system”, Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing Multicul-turality - TEEM, (2015), pp: 31-37, doi:10.1145/2808580.2808586
Guhl J, Tung S, & Kruger J, “Concept and architecture for pro-gramming industrial robots using augmented reality with mobile de-vices like microsoft HoloLens”, IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). (2017). doi:10.1109/etfa.2017.8247749
Nguyen H, Ketchell S, Engelke U, Thomas HB, & Souza DP, “Augmented Reality Based Bee Drift Analysis: A User Study”, In-ternational Symposium on Big Data Visual Analytics (BDVA), (2017) doi:10.1109/bdva.2017.8114581.
Garon M, Boulet P, Doironz J, Beaulieu L, & Lalonde L, “Real-Time High Resolution 3D Data on the HoloLens”. IEEE Interna-tional Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2016), doi:10.1109/ismar-adjunct.2016.0073.
Widmer A, Schaer R, Markonis D, Muller H, “Facilitating medical information search using Google Glass connected to a content-based medical image retrieval system”. 2014 36th Annual Interna-tional Conference of the IEEE Engineering in Medicine and Biology Society, (2014), doi:10.1109/embc.2014.6944625.
Kowalsk M, Nasarzewski Z, Galinski G, Garbat P, “HoloFace: Augmenting Human-to-Human Interactions on HoloLens”. IEEE Winter Conference on Applications of Computer Vision (WACV), (2018). doi:10.1109/wacv.2018.00022.
Xie T, Islam MM, Lumsden BM, Kakadiaris AI. “Holographic iRay: Exploring Augmentation for Medical Applications”. IEEE In-ternational Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2017), doi:10.1109/ismar-adjunct.2017.73
Kopf J, Fu C, Cohen-Or D, Deussen O, Lischinski D, Wong T, “Solid texture synthesis from 2D exemplars” ACM SIGGRAPH 2007 Papers on - SIGGRAPH 07, (2007), doi:10.1145/1275808.1276380.
Abada L, Aouat D, “Enhanced variational approach by Fast-Marching to recover a 3D shape from shading” Proceedings of the 20th International Database Engineering & Applications Symposium on - IDEAS 16, (2016), doi:10.1145/2938503.2938504.
Mujika MK, Méndez AJ, Miguel FA, “Workstation versus Free Open Source Software in radiology”. Proceedings of the 5th Inter-national Conference on Technological Ecosystems for Enhancing Multiculturality – TEEM, (2017), doi:10.1145/3144826.3145411