Robotic Arm System with Computer Vision for Colour Object Sorting
About this article
DOI:
https://doi.org/10.14419/ijet.v7i4.27.22479Keywords:
Robotic Arm, Image Processing Technique, Forward Kinematic, Denavit-Hartenberg Algorithm, Modified Flower Pollination AlgorithmAbstract
This study presents the development of robotic arm with computer vision functionalities to recognise the objects with different colours, pick up the nearest target object and place it into particular location. In this paper, the overview of the robotic arm system is first presented. Then, the design of five-degrees of freedom (5-DOF) robotic arm is introduced, followed by the explanation of the image processing technique used to recognize the objects with different colours and obstacle detection. Next, the forward kinematic modelling of the robotic arm using Denavit-Hartenberg algorithm and solving the inverse kinematic of the robotic arm using modified flower pollination algorithm (MFPA) are interpreted. The result shows that the robotic arm can pick the target object accurately and place it in its particular place successfully. The concern on user safety is also been taken into consideration where the robotic arm will stop working when the user hand (obstacle) is detected and resume its process when there is no obstacle.
References
Abdou, G., & Lee, E. (1991). "Physical model for robotics palletization. Computers in Industry", 16(3), 255–266. https://doi.org/10.1016/0166-3615(91)90063-F
Almendral, K. A. M., Babaran, R. M. G., Carzon, B. J. C., Cu, K. P. K., Lalanto, J. M., & Abad, A. C. (2018). "Autonomous Fruit Harvester with Machine Vision. Journal of Telecommunication", Electronic and Computer Engineering, 10(1), 79–86. Retrieved from http://journal.utem.edu.my/index.php/jtec/article/view/3671/2554
Artemiadis, P. K., Katsiaris, P. T., & Kyriakopoulos, K. J. (2010). "A biomimetic approach to inverse kinematics for a redundant robot arm. Autonomous Robots", 29(3-4), 293–308. https://doi.org/10.1007/s10514-010-9196-x
Brunetti, A., Buongiorno, D., Trotta, G. F., & Bevilacqua, V. (2018). "Computer vision and deep learning techniques for pedestrian detection and tracking: A survey. Neurocomputing", 300, 17–33. https://doi.org/10.1016/j.neucom.2018.01.092
Culler, D., & Long, J. (2016). "A Prototype Smart Materials Warehouse Application Implemented Using Custom Mobile Robots and Open Source Vision Technology Developed Using EmguCV". Procedia Manufacturing, 5, 1092–1106. https://doi.org/10.1016/j.promfg.2016.08.080
View more references (20)
Dharmannagari, V. K. R. (2014). "Sorting of Objects Based on Colour By Pick and Place Robotic Arm and With", 3(1).
Dhepekar, P., & Adhav, Y. G. (2017). "Wireless robotic hand for remote operations using flex sensor. International Conference on Automatic Control and Dynamic Optimization Techniques, ICACDOT" 2016, 114–118. https://doi.org/10.1109/ICACDOT.2016.7877562
Gu, J., Wang, H., Pan, Y., & Wu, Q. (2015). "Neural network based visual servo control for CNC load/unload manipulator". Optik, 126(23), 4489–4492. https://doi.org/10.1016/j.ijleo.2015.07.153
Hayashi, S., Ota, T., Kubota, K., Ganno, K., & Kondo, N. (2005). "Robotic Harvesting Technology for Fruit Vegetables in Protected Horticultural Production. FRUTIC 05", Information and Technology for Sustainable Fruit and Vegetable Production, (September), 227–236.
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009)." Learning to detect unseen object classes by between-class attribute transfer". 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, 2009 IEEE , 951–958. https://doi.org/10.1109/CVPRW.2009.5206594
Li, S., Chen, S., Liu, B., Li, Y., & Liang, Y. (2012). "Decentralized kinematic control of a class of collaborative redundant manipulators via recurrent neural networks". Neurocomputing, 91, 1–10. https://doi.org/10.1016/j.neucom.2012.01.034
Li, X., Qiao, T., Pang, Y., Zhang, H., & Yan, G. (2018). "A new machine vision real-time detection system for liquid impurities based on dynamic morphological characteristic analysis and machine learning. Measurement": Journal of the International Measurement Confederation, 124(October 2017), 130–137. https://doi.org/10.1016/j.measurement.2018.04.015
Li, Y., Huang, T., & Chetwynd, D. G. (2018). "An approach for smooth trajectory planning of high-speed pick-and-place parallel robots using quintic B-splines". Mechanism and Machine Theory, 126, 479–490. https://doi.org/10.1016/j.mechmachtheory.2018.04.026
Martinez-De Dios, J. R., & Ollero, A. (2015). "A learning-based thresholding method customizable to computer vision applications". Engineering Applications of Artificial Intelligence, 37, 71–90. https://doi.org/10.1016/j.engappai.2014.08.015
Mehta, S. S. (2007). "Vision-Based Control for Autonomous Robotic Citrus Harvesting".
Moghaddam, M., & Nof, S. Y. (2016). "Parallelism of Pick-and-Place operations by multi-gripper robotic arms". Robotics and Computer Integrated Manufacturing, 42, 135–146. https://doi.org/10.1016/j.rcim.2016.06.004
Nearchou, A. C. (1998). "Solving the inverse kinematics problem of redundant robots operating in complex environments via a modified genetic algorithm""Application of Modified Flower Pollination Algorithm on Mechanical Engineering Design Problem. Batu Pahat, Johor.
Rai, N., Rai, B., & Rai, P. (2014). "Computer Vision Approach for Controlling Educational Robotic Arm based on Object Properties" .
Reddy, R., & Nagaraja, S. R. (2015). "Integration of robotic arm with vision system". 2014 IEEE International Conference on Computational Intelligence and Computing Research, IEEE ICCIC 2014, 373–378. https://doi.org/10.1109/ICCIC.2014.7238302
Sajjad, M., Talpur, H., & Shaikh, M. H. (2012). "Automation of Mobile Pick and Place Robotic System for Small", 522–526.
Sangeetha, G. R., Kumar, N., Hari, P. R., & Sasikumar, S. (2018). "Implementation of a Stereo vision based system for visual feedback control of Robotic Arm for space manipulations". Procedia Computer Science, 133, 1066–1073. https://doi.org/10.1016/j.procs.2018.07.031
Saxena, a., Driemeyer, J., & Ng, a. Y. (2008). "Robotic Grasping of Novel Objects using Vision"". The International Journal of Robotics Research, 27(2), 157–173. https://doi.org/10.1177/0278364907087172
Starke, S. (2016). "A Hybrid Genetic Swarm Algorithm for Interactive Inverse Kinematics". MSc Thesis.
Taylor, P. (2007). "On Optimizing Bin Picking and Insertion Plans for Assembly Robots On Optimizing Bin Picking and Insertion" Plans for Assembly Robots, (December 2013), 37–41.
Zhang, Y., & Wang, J. (2004). "Obstacle Avoidance for Kinematically Redundant Manipulators Using a Dual Neural Network", 34(1), 752–759.