Electrostatic interactions near surfaces and interfaces are ubiquitous in many fields of science. Continuum electrostatics predicts that ions will be attracted to conducting electrodes but repelled by surfaces with lower dielectric constant than the solvent. However, several recent studies found that certain “chaotropic” ions have similar adsorption behavior at air/water and graphene/water interfaces. Here we systematically study the effect of polarization of the surface, the solvent, and solutes on the adsorption of ions onto the electrode surfaces using molecular dynamics simulation. An efficient method is developed to treat an electrolyte system between two parallel conducting surfaces by exploiting the mirror-expanded symmetry of the exact image-charge solution. With neutral surfaces, the image interactions induced by the solvent dipoles and ions largely cancel each other, resulting in no significant net differences in the ion adsorption profile regardless of the surface polarity. Under an external electric field, the adsorption of ions is strongly affected by the surface polarization, such that the charge separation across the electrolyte and the capacitance of the cell is greatly enhanced with a conducting surface over a low-dielectric-constant surface. While the extent of ion adsorption is highly dependent on the electrolyte model (the polarizability of solvent and solutes, as well as the van der Waals radii), we find the effect of surface polarization on ion adsorption is consistent throughout different electrolyte models.