An Augmented Reality based framework that aids maintenance field activities

Authors

DOI:

https://doi.org/10.33448/rsd-v11i13.35336

Keywords:

Augmented Reality; Telecommunications; Fiber optics; Maintenance.

Abstract

In recent years, a huge variety of Augmented Reality (AR)-based applications have been developed for use on mobile devices. This technology has also been sought by companies, which have envisioned the possibility of obtaining cost savings in several activities, such as maintenance tasks. By evaluating publications and commercial applications related to this specific topic, some initiatives that integrate some technologies are perceived, without exploring all possible benefits. The objective of this work is the implementation of a new framework based on augmented reality, geographical data and image recognition on mobile devices, in order to allow a user to receive the identification of a desired object directly on the screen of his smartphone, as well as additional information to assist his tasks of interacting with an object. A systematic review was carried out to compare approaches already implemented that could contribute to the development of the solution. Tests were also carried out in a commercial application, and case studies related to this theme were evaluated. The framework proposal was then developed and validated by a proof of concept, applying the system to maintenance activities performed by field technicians working for a Telecommunications company. The image recognition worked properly, with the correct identification of the georeferenced object and displaying the requested information through AR. It was verified, therefore, that the proposed application is valid for use in maintenance tasks in the field and can reduce the average maintenance time of each customer and provide greater accuracy of the information used by the technicians. 

References

ACM Digital Library (2019). https://dl.acm.org/.

Alavikia, Z. & Shabro, M. (2019). Pragmatic Industrial Augmented Reality in Electric Power Industry, 34th Power System Conference, 25-32.

Aleksy, M. et al. (2014). Augmented reality for improved service delivery. 2014 IEEE 28th International Conference on Advanced Information Networking and Applications. IEEE, 382-9.

AUGEO® (2019). Release note. https://www.esri.com/arcgis-blog/products/3d-gis/3d-gis/ar-for-your-gis/.

Bergenti, F. & Gotta, D. (2014). Augmented reality for field maintenance of large telecommunication networks. Conference and Exhibition of the European Association of Virtual and Augmented Reality, 125-129.

Billinghurst, M. (2002). Augmented reality in education. New horizons for learning, 12(5), 1-5.

Bottani, E. & Vignali, G. (2019). Augmented reality technology in the manufacturing industry: A review of the last decade. IISE Transactions, 51(3), 284-310.

Cardoso, A. et al. (2019). Use of Virtual and Augmented Reality as Tools for Visualization of Information: A Systematic Review. International Conference on Intelligent Human Systems Integration, 407-417.

Cardoso, L. F., Mariano, F. & Zorzal, E. (2020). A survey of industrial augmented reality. Computers & Industrial Engineering, 139, 106159.

Ceruti, A. et al. (2019). Maintenance in Aeronautics in an Industry 4.0 Context: The Role of Augmented Reality and Additive Manufacturing. Journal of Computational Design and Engineering, 6(4), 516-526.

Chiang, T. H. C., Yang, S. J. H. & Hwang, G-J (2014). An augmented reality-based mobile learning system to improve students’ learning achievements and motivations in natural science inquiry activities. Journal of Educational Technology & Society, 17(4), 352-65.

Cordonnier, M. et al. (2017). Contribution of augmented reality to the maintenance of network equipment. CIRED-Open Access Proceedings Journal, 2017(1), 87-90.

Del Amo, I. F. et al. (2018). Augmented Reality in Maintenance: An information-centred design framework. Procedia Manufacturing, 19, 148-155.

ENEL Distribuição SP (2019). Projeto Urban Futurability. https://www.eneldistribuicaosp.com.br/urban-futurability.

Gallala, A.; Hichri, B. & Plapper, P. (2019). Survey: The Evolution of the Usage of Augmented Reality in Industry 4.0. IOP Conference Series: Materials Science and Engineering. 521(1), 012017.

Gattullo, M. et al. (2017). From paper manual to AR manual: do we still need text?. Procedia Manufacturing, 11, 1303-1310.

General Electric (2017). Report Looking Smart: Augmented Reality Is Seeing Real Results In Industry.

https://www.ge.com/reports/looking-smart-augmented-reality-seeing-real-results-industry-today/.

Google Acadêmico (2019). https://scholar.google.com.

GUI Cascade Trainer (2022). https://amin-ahmadi.com/cascade-trainer-gui.

Hamilton, K. & Olenewa, J. (2011). Augmented reality in education. Proc. SXSW Interactive, 1008-1022.

IEEE Xplore (2019). http://ieeexplore.ieee.org/Xplore/home.jsp.

Kerawalla, L. et al. (2006). “Making it real”: exploring the potential of augmented reality for teaching primary school science. Virtual reality, 10(3), 163-174.

Klopfer, E. & Yoon, S. (2004). Developing games and simulations for today and tomorrow’s tech savvy youth. TechTrends, 49(3), 33-41.

Lamberti, F. et al. (2014). Challenges, opportunities, and future trends of emerging techniques for augmented reality-based maintenance. IEEE Transactions on Emerging Topics in Computing, 2(4), 411-421.

Mapbox (2022). https://www.mapbox.com.

Martinetti, A.; Rajabalinejad, M. & Van Dongen, L. (2017). Shaping the future maintenance operations: reflections on the adoptions of Augmented Reality through problems and opportunities. Procedia CIRP, 59, 14-17.

Masood, T. & Egger, J. (2019). Augmented reality in support of Industry 4.0—Implementation challenges and success factors. Robotics and Computer-Integrated Manufacturing, 58, 181-195.

Ogushi, I.. (2013). Operation and maintenance work using AR technology for optical access networks. National Fiber Optic Engineers Conference, NM2I-3.

Olbrich, M. et al. (2013). Augmented reality supporting user-centric building information management. The visual computer, 29(10), 1093-1105.

Oliveira, R. et al. (2013). An augmented reality application to support maintenance–is it possible?. Maintenance Performance Measurement and Management Conference: 12/09/2013-13/09/2013, 260-271.

OpenCV (2022). https://opencv.org.

Ortega, Sebastián et al. (2019). Making the Invisible Visible—Strategies for Visualizing Underground Infrastructures in Immersive Environments. ISPRS International Journal of Geo-Information, 8(3), 152.

Palmarini, Riccardo et al. (2018). A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 49, 215-228.

Python (2021). https://www.python.org/.

Quint, F.; Loch, F. & Bertram, P. (2017). The Challenge of Introducing AR in Industry-Results of a Participative Process Involving Maintenance Engineers. Procedia Manufacturing, 11, 1319-1323.

Ramirez, Hector et al. (2013). Authoring software for augmented reality applications for the use of maintenance and training process. Procedia Computer Science, 25, 189-193.

Science Direct (2019). https://www.sciencedirect.com.

Shelton, B. E. & Hedley, N. (2002). Using Augmented Reality for Teaching Earth-Sun Relationships to Undergraduate Geography Students, The First IEEE International Workshop Agumented Reality Toolkit, 8.

Unity (2021). https://unity.com.

Zhang, Xiaolei et al. (2016). ARGIS-based outdoor underground pipeline information system. Journal of Visual Communication and Image Representation, 40, 779-790.

Published

06/10/2022

How to Cite

COLETA, G. F. D.; CARDOSO, A.; LAMOUNIER JÚNIOR, E. A.; LIMA, G. F. M. de; FERNANDES, M. An Augmented Reality based framework that aids maintenance field activities. Research, Society and Development, [S. l.], v. 11, n. 13, p. e242111335336, 2022. DOI: 10.33448/rsd-v11i13.35336. Disponível em: https://rsdjournal.org/index.php/rsd/article/view/35336. Acesso em: 26 apr. 2024.

Issue

Section

Exact and Earth Sciences