Immersive Environments with Haptic Technology for the Control of an Industrial Robotic Arm

Authors

  • Wilman Paucar Ingeniería Electrónica, Universidad Politécnica Salesiana
  • Gustavo Caiza Ingeniería Electrónica, Universidad Politécnica Salesiana
  • William Oñate Ingeniería Electrónica, Universidad Politécnica Salesiana
  • Morelva Saeteros Institute of Technology, University of Deusto

DOI:

https://doi.org/10.64552/wipiec.v10i2.63

Keywords:

Senso Glove, Mitsubishi RV-2AJ Robotics Arm, Internet of Things, Unity

Abstract

The technological advancement of Industry 4.0 and the Internet of Things has brought significant changes and benefits to the industry, allowing observation, control, and decision-making in industrial processes from anywhere in the world and in real-time. This article presents the power of a Mitsubishi RV-2AJ Industrial Robotic Arm using haptic technology "Senso Glove" and real-time 3D visualization, enabling users to interact and control the arm's movements. For the implementation, data is processed in Unity and sent to the "Firebase" cloud, where this data is requested by an embedded system to subsequently be converted into commands for arms control, specifically in the coordinates "X", "Y", "Z," and in the opening or closing of the gripper. The results demonstrated that the arm can be controlled from the gloves, opening various applications. Additionally, an accuracy of 87.8% was achieved in the conducted tests, with an average communication time of 815 milliseconds.

References

Kumar, V., Vrat, P. & Shankar, R. (2022). Factors Influencing the J Implementation of Industry 4.0 for Sustainability in Manufacturing. Glob Flex Syst Manag 23, 453-478. https://bibliotecas.ups.edu.ec:2582/10.1007/s40171-022-00312-1 DOI: https://doi.org/10.1007/s40171-022-00312-1

García, C. A., Caiza, G., Guizado, D., Naranjo, J. E., Ortiz, A., Ayala, P. & Garcia, M. (2023). Visualization of Key Performance Indicators in the Production System in the Context of Industry 4.0. IFAC-PapersOnLine, 56(2), 6582-6587. https://www.sciencedirect.com/science/article/pii/S2405896323006663 DOI: https://doi.org/10.1016/j.ifacol.2023.10.310

Yenorkar, R. & Chaskar, U. (2018). GUI Based Pick and Place Robotic Arm for Multipurpose Industrial Applications. Second International Conference on Intelligent Computing and Control Systems (ICICCS), 200-203. DOI: https://doi.org/10.1109/ICCONS.2018.8663079

Barrientos, A., Peñín, L. F., Balaguer, C. & Aracil, R. (2007). Fundamentos de Robótica. Madrid. McGRAW-HILL, 2da. Edición.

Harikrishnan, M., Ghanshsyam, T., Chourasia, G., Das, A., Shrivastava, A. & Bhatt, Z. (2018). Flamen − 7 DOF Robotic Arm to Manipulate a Spanish Fan. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 4152-4157. DOI: https://doi.org/10.1109/IROS.2018.8594129

Park, J. & Jung, S. (2023). Form-Finding to Fabrication: A Parametric Shell Structure Fabricated Using an Industrial Robotic Arm with a Hot-Wire End-Effector. Nexus Network Journal, 1522-4600. DOI: https://doi.org/10.1007/s00004-023-00720-5

Eshah, N. S., Osman, K., & Zainuddin N. (2020). 5-Axis of Mitsubishi RV-2AJ Robotics Arm Modelling Using Solidworks. 16th IEEE International Colloquium on Signal Processing & Its Applications (CSPA), 207-212. DOI: https://doi.org/10.1109/CSPA48992.2020.9068674

Buitrago J. A., Giraldo F. D. & Lamprea J. A. (2011). Remote access lab for Mitsubishi RV-2AJ robot. IX Latin American Robotics Symposium and IEEE Colombian Conference on Automatic Control, 1-7. DOI: https://doi.org/10.1109/LARC.2011.6086802

Agurto, J., Bonilla, V., Moya Cajas, M., Mosquera, G., Paredes, R. & Litvin, A. (2019). Mitsubishi RV-2AJ Robot Controled by Electromyographic Signals. International Conference on Information Systems and Computer, 77-82. DOI: https://doi.org/10.1109/INCISCOS49368.2019.00021

Weber P., Rueckert E., Calandra R., Peters J. & Beckerle P. (2016). A low-cost sensor glove with vibrotactile feedback and multiple finger joint and hand motion sensing for human-robot interaction. IEEE International Symposium on Robot and Human Interactive Communication, 99-104. DOI: https://doi.org/10.1109/ROMAN.2016.7745096

Peralta, J. & Smarsly, K. (2022). An Introduction and Systematic Review on Machine Learning for Smart Environments/Cities: An IoT Approach. Machine Learning for Smart Environments/Cities. Intelligent Systems Reference Library, V 121. https://doi.org/10.1007/978-3-030-97516-6_1 DOI: https://doi.org/10.1007/978-3-030-97516-6_1

Ghoul, Y. & Naifar, O. (2023). IoT based applications for healthcare and home automation. Multimed Tools Appl, https://bibliotecas.ups.edu.ec:2582/10.1007/s11042-023-16774-z DOI: https://doi.org/10.1007/s11042-023-16774-z

Cajamarca, J. A. & Portilla, A. D. (2016). Implementación de un controlador para la cinemática inversa del brazo robot Mitsubishi RV-2AJ a través de una tarjeta ARM y Matlab. Universidad Politécnica Salesiana. 17-18.

Ayob, M. A., Zakaria, W. N., & Jalani, J. (2014). Forward kinematics analysis of a 5-axis RV-2AJ robot manipulator. Electrical Power, Electronics, Communications, Control and Informatics Seminar (EECCIS), 87-92. DOI: https://doi.org/10.1109/EECCIS.2014.7003725

Crainic, M. & Preitl, S. (2016). Development of a special setup for path tracking of RV-2AJ robot. IEEE 11th International Symposium on Applied Computational Intelligence and Informatics (SACI), 217-220. DOI: https://doi.org/10.1109/SACI.2016.7507372

Fahmi, F., Nainggolan, F., Siregar, B., Gaweng, S. & Zarlis, M. (2020). User experience study on crane operator erection simulator using senso glove in a virtual reality environment. IOP Conference Series: Materials Science and Engineering, V.851, 012023. DOI: https://doi.org/10.1088/1757-899X/851/1/012023

Le, G.T., Tran, N.M., Tran, T.V. (2021). IoT System for Monitoring a Large-Area Environment Sensors and Control Actuators Using Real-Time Firebase Database. Intelligent Human Computer Interaction, Vol 12616. 3-20. DOI: https://doi.org/10.1007/978-3-030-68452-5_1

Moroney, L. (2017). The Firebase Realtime Database. In: The Definitive Guide to Firebase, https://doi.org/10.1007/978-1-4842-2943-9_3 DOI: https://doi.org/10.1007/978-1-4842-2943-9

Bucsai, S., Kučera, E., Haffner, O. & Drahoš, P. (2020). Control and Monitoring of IoT Devices Using Mixed Reality Developed by Unity DOI: https://doi.org/10.1109/KI48306.2020.9039901

Engine. Cybernetics & Informatics (K&I), 1-8.

Caiza, G., Saeteros, M., Oñate, W. & García M. (2020). Fog computing at industrial level, architecture, latency, energy, and security: A review. Heliyon, V. 6(4). DOI: https://doi.org/10.1016/j.heliyon.2020.e03706

Caiza, G., Chiliquinga, S., Manzano, S. & García, V. (2020). Software-Defined Network (SDN) Based Internet of Things within the context of low-cost automation. IEEE 18th International Conference on Industrial Informatics (INDIN), 587-591. DOI: https://doi.org/10.1109/INDIN45582.2020.9442180

Downloads

Published

2024-08-20

How to Cite

Paucar, W., Caiza, G., Oñate, W., & Saeteros, M. (2024). Immersive Environments with Haptic Technology for the Control of an Industrial Robotic Arm. WiPiEC Journal - Works in Progress in Embedded Computing Journal, 10(2), 5. https://doi.org/10.64552/wipiec.v10i2.63

Issue

Vol. 10 No. 2 (2024): WiPiEC Journal — Special Issue

Section

Full Paper

License

Copyright (c) 2024 Wilman Paucar, Gustavo Caiza, William Oñate, Morelva Saeteros

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

License Terms: 

Except where otherwise noted, content on this website is lincesed under a  Creative Commons Attribution Non-Commercial License (CC BY NC) 

Use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes, is permitted.

Copyright to any article published by WiPiEC retained by the author(s). Authors grant WiPiEC Journal a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as it is not used for commercial purposes and its original authors, citation details, and publisher are identified, in accordance with CC BY NC license. Fore more information on license terms, click here.