Generation of plant dyeing stylized artwork based on diffusion model

Abstract

With the improvement of people's living standards, people have higher clothing safety and artistry requirements. Plant dyeing artworks use plant sap to dye natural and woven fabrics, thus creating a print close to nature, gorgeous in style, and free from the harmful components of chemical dyeing, which is recognized and widely used by highly knowledgeable people. However, the type and the design of plant dyeing artworks need to incorporate the artist's creative inspiration, which is limited by human work efficiency. It constrains the creation of plant-dyeing artworks and limits the speed of innovation. Deep learning has made significant progress in the field of artistic creation. In this paper, we propose to combine the Disco Diffusion model with the creation of plant-dyeing artworks. The high-quality image generation capability of the Diffusion model and multi-modal content description is utilized to design and generate plant dyeing artworks. The original style is firstly modeled after photographs of the original plant dyeing artwork. The style type is further expanded using text descriptions. The Disco Diffusion model is then used to create the final plant-dyeing piece of art. The experiment results show that generating plant dyeing paintings based on the Disco Diffusion model achieves better visual results. Through the controlled generation process and high-quality work generation results, the stylized plant dyeing design works is obtained automatically. It provides strong support for the creation of plant dyeing art.