All-sky distributions of the polarized radiance are measured using an automated fish-eye camera system with a rotating polarizer. For a large range of aerosol and surface albedo situations, the influence on the degree of polarization and sky radiance is investigated. The range of aerosol optical depth and albedo is 0.05–0.5 and 0.1–0.75, respectively. For this range of parameters, a reduction of the degree of polarization from about 0.7 to 0.4 was observed. The analysis is done for 90° scattering angle in the principal plane under clear sky conditions for a broadband channel of 450 ± 25 nm and solar zenith angles between 55° and 60°. Radiative transfer calculations considering three different aerosol mixtures are performed and and agree with the measurements within the statistical error.