We investigate the shape and size effects of gold metallic nanoparticles on the enhancement of exciton-plasmon coupling and emission of semiconductor quantum dots induced via the simultaneous impact of metal-oxide and plasmonic effects. This enhancement occurs when metallic nanoparticle arrays are separated from the quantum dots by a layered thin film consisting of a high index dielectric material (silicon) and aluminum oxide. Our results show that adding the aluminum oxide layer can increase the degree of polarization of quantum dot emission induced by metallic nanorods by nearly two times, when these nanorods have large aspect ratios. We show when the aspect ratio of these nanorods is reduced to half, the aluminum oxide loses its impact, leading to no improvement in the degree of polarization. These results suggest that a silicon/aluminum oxide layer can significantly enhance exciton-plasmon coupling when quantum dots are in the vicinity of metallic nanoantennas with high aspect ratios.