Robotic Sponge and Watercolor Painting Based on Image-Processing and Contour-Filling Algorithms

Scalera, Lorenzo; Canever, Giona; Seriani, Stefano; Gasparetto, Alessandro; Gallina, Paolo

doi:10.3390/act11020062

Cited by 5 publications

(2 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In a recent paper, Scalera et al (2022) use a sponge to fill in regions. They propose a contour-filling algorithm that considers the sponge's footprint and creates paths that paint a given area without violating the defined outline.…”

Section: Related Workmentioning

confidence: 99%

Region-Based Approaches in Robotic Painting

Gülzow

Deußen

2022

Arts

View full text Add to dashboard Cite

An important aspect of robotic painting is replicating human painting techniques on machines, in order to automatically produce artwork or to interact with a human painter. Usually, painterly rendering techniques are transferred to the machine, and strokes are used as the basic building block of an image, as they can easily be mapped to the robot. In contrast, we propose to consider regions as a basic primitive to achieve more human-like results and to make the painting process more modular. We analyze the works of Kadinsky, Mondrian, Delaunay, and van Gogh to show the basis of region-based techniques in the real world and then transfer them to an automatic context. We introduce different types of region primitives and show procedures for how to realize them on our painting machine e-David, capable of painting with visual feedback. Finally, we present machine-created artwork by painting automatically generated sets of shapes in the styles of various artists.

show abstract

Section: Related Workmentioning

confidence: 99%

Region-Based Approaches in Robotic Painting

Gülzow

Deußen

2022

Arts

View full text Add to dashboard Cite

show abstract

“…A contour-filling algorithm was developed to define the sponge positions and orientations in order to colour the image contour. 8 Nasrat et al 9 utilised CycleGAN to extract crucial facial features and implemented a path optimisation algorithm. This implement enabled the robotic arm to efficiently produce high-quality portrait drawings in a short amount of time.…”

Section: Introductionmentioning

confidence: 99%

Using genetic algorithm for drawing path planning in a robotic arm pencil sketching system

Shaw,

Lee

2024

Proceedings of the Institution of Mechanical Engineers, Part C:

View full text Add to dashboard Cite

The purpose of this study is to implement a robotic arm pencil sketching system through a novel drawing path planning method. Firstly, to enhance the craftsmanship and uniqueness of the artwork, the original image is transformed into an animated style using AnimeGANv2. After image processing, the image is divided into boundary and background layers for drawing path planning. In the realm of path planning, traditional methods often involve manual path design by artists, and only recently have automated path planning methods been proposed. However, these recent approaches still have some limitations. For instance, a pursuit of efficiency can lead to overly uniform strokes, making the artwork resemble a print rather than a genuine piece of art. Therefore, this study introduces a new path-planning approach based on the traveling salesman problem (TSP), utilising various algorithms for path-planning experiments. Different stroke effects generated by distinct algorithms are applied to appropriate areas. The aim is to let the generated artworks exhibit the technological appeal of algorithms while retaining the distinctive characteristics of pencil sketches. For robotic arm control, a force sensor is integrated onto the arm, and a proportional-integral-derivative (PID) controller is employed to monitor and precisely control the drawing force. Experimental results demonstrate that artworks created using genetic algorithms to generate drawing paths exhibit distinct colour-layering effects, emphasising the characteristics of pencil strokes. In comparison with previous methods, this approach effectively addresses the issue of overly uniform and rigid strokes in past techniques.

show abstract