Integration of Computervision and Artificial Intelligence Subsystems with Robot Operating System Based Motion Planning for Industrial Robots

Ārents, Jānis; Cacurs, Ričards; Greitāns, Modris

doi:10.3103/s0146411618050024

Cited by 7 publications

(4 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Typically this workspace scales down to a region of interest or objects of interest to which the robot is manipulating. Nevertheless, there can be different types of uncertainties in the robots' workspace such as randomly placed objects [20], dynamic obstacles [21], and human presence, etc. Usually, such tasks cannot be preprogrammed and the robotic system strictly depends on the information that it receives from the environment and the learned strategies.…”

Section: Significance Of Smart Industrial Robots In Manufacturingmentioning

confidence: 99%

Smart Industrial Robot Control Trends, Challenges and Opportunities within Manufacturing

2022

Self Cite

View full text Add to dashboard Cite

Industrial robots and associated control methods are continuously developing. With the recent progress in the field of artificial intelligence, new perspectives in industrial robot control strategies have emerged, and prospects towards cognitive robots have arisen. AI-based robotic systems are strongly becoming one of the main areas of focus, as flexibility and deep understanding of complex manufacturing processes are becoming the key advantage to raise competitiveness. This review first expresses the significance of smart industrial robot control in manufacturing towards future factories by listing the needs, requirements and introducing the envisioned concept of smart industrial robots. Secondly, the current trends that are based on different learning strategies and methods are explored. Current computer-vision, deep reinforcement learning and imitation learning based robot control approaches and possible applications in manufacturing are investigated. Gaps, challenges, limitations and open issues are identified along the way.

show abstract

Section: Significance Of Smart Industrial Robots In Manufacturingmentioning

confidence: 99%

Smart Industrial Robot Control Trends, Challenges and Opportunities within Manufacturing

2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…Detection and segmentation of objects that are randomly piled combined with an industrial robot pick and place operation [3] are commonly referred to as bin-picking. Even though this problem has been addressed by the research community for several decades, it remains one of the most challenging tasks in robotics [2] [6].…”

Section: Related Workmentioning

confidence: 99%

Synthetic Data of Randomly Piled, Similar Objects for Deep Learning-Based Object Detection

Arents,

Lesser,

Bizuns

et al. 2022

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Currently, the best object detection results are achieved by supervised deep learning methods, however, these methods depend on annotated training data. With the synthetic data generation approach, we intend to mimic the real data characteristics and diversify the dataset by a systematic rendering of highly realistic synthetic pictures. We systematically explore how different combinations and portions of real and synthetic datasets affect object detectors performance. The developed synthetic data generation framework shows promising results in deep learning-based object detection tasks and can supplement real data when the variety of real training data is insufficient. However, when synthetic data ratio increases over real data ratio, a decrease in average precision can be observed, which has the most affect on 0.75-0.95 IoU threshold range.

show abstract

“…Typically this workspace scales down to a region of interest (ROI) or objects of interest to which the robot is manipulating. Nevertheless, there can be different types of uncertainties in the robots' workspace, such as randomly placed objects [4], dynamic obstacles [16], and human presence, etc. Usually, such tasks cannot be preprogrammed, and the robotic system strictly depends on the information it receives from the environment and the learned strategies.…”

Section: Overview and Trends Of Smart Control Methods For Industrial ...mentioning

confidence: 99%

“…• "Vision, Identification, with Z-sensing Technology and key Applications" (VIZTA, GA:826600), • "Intelligent Motion Control under Industry 4.E" (IMOCO4.E, GA:101007311). Horizon 2020 project: [4][5][6][7][8][9][10], scientific conferences [11][12][13], and book chapters [14,15]. Part of the research activities of the Thesis are included in the "Smart robot system with advanced vision, sensing, and human gesture understanding capabilities" which was evaluated by the Latvian Academy of Sciences in the annual Science Achievements' Competition as one of the most significant scientific achievements in Latvia in 2022¹.…”

Section: Practical Value and Approbationmentioning

confidence: 99%

Research and Development of Smart Control Methods for Industrial Robots

Ārents

View full text Add to dashboard Cite

This thesis addresses the smart control methods for industrial robots, their applications, and learning strategies, in particular focusing on efficient data preparation, computer vision-based robot control, and knowledge acquisition from humans through demonstrations. The primary aim of the Thesis is to research and develop novel techniques in these fields to improve the potential deployment of industrial robots for working in dynamic environments and advance the operability of such systems. Based on the identified challenges and open issues during the literature review, the Thesis develops and evaluates novel synthetic data generation techniques for usage in computer vision-based robot control and an approach for learning from human demonstrations.

show abstract

Integration of Computervision and Artificial Intelligence Subsystems with Robot Operating System Based Motion Planning for Industrial Robots

Cited by 7 publications

References 15 publications

Smart Industrial Robot Control Trends, Challenges and Opportunities within Manufacturing

Smart Industrial Robot Control Trends, Challenges and Opportunities within Manufacturing

Synthetic Data of Randomly Piled, Similar Objects for Deep Learning-Based Object Detection

Research and Development of Smart Control Methods for Industrial Robots

Contact Info

Product

Resources

About