Since cleaning of artworks is a nonreversible procedure, it is mandatory to adopt the proper cleaning technique which has the ability to remove undesired materials whilst preserving the original surface and, if present, the original ‘patina’ of the surface layer. In this regard, numerous gels have been developed and exploited for the cleaning of various artwork surfaces. Lately, agarose (AG) and polyvinyl alcohol-borax (PVA-B) hydrogels have been widely employed as cleaning tools by conservators-restorers. Both hydrogels show some limitations in specific cleaning practices. In this work, we investigated the influence of including increased levels of agarose into PVA-B systems. For this reason, we performed a detailed characterization on the double network (DN) hydrogel including the chemical structure, the liquid phase retention, the rheological behaviour, and the self-healing behaviour of various PVA-B/AG double network hydrogels. These new hydrogels revealed better properties than PVA-B hydrogels and obviated their limitations. The inclusion of AG into PVA-B systems enhanced the liquid retention capacity, shape-stability, and mechanical strength of the blend. Furthermore, AG minimized the expelling/syneresis issue that occurs when loading PVA-B systems with non-polar solvents or chelating agents. The resultant double network hydrogel exhibits relevant self-healing properties. The PVA-B/AG double network is a new and useful cleaning tool that can be added to the conservators-restorers’ tool-kit. It is ideal for cleaning procedures dealing with porous and complex structured surfaces, vertical surfaces and for long time applications.