The continuous development of ALD thin films demands ongoing improvements and changes toward fabricating materials with tailored properties that are suitable for different practical applications. Ozone has been recently established as a precursor, with distinct advantages over the alternative oxidizing precursors in the ALDs of advanced dielectric films. This study reports alumina (Al2O3) and hafnia (HfO2) formation using an O3 source and compares the obtained structural and electrical properties. The performed structural examinations of ozone-based materials proved homogenous high-k films with less vacancy levels compared to water-based films. The enhanced structural properties also result in the problematic incorporation of different dopants through the bulk layer. Furthermore, analysis of electrical characteristics of the MIS structures with ALD gate dielectrics demonstrated the improved quality and good insulating properties of ozone-based films. However, further optimization of the ALD technique with ozone is needed as a relatively low relative permittivity characterizes the ultra-thin films.