In this paper, we study a system of two Rössler oscillators coupled through a time-varying link, periodically switching between two values. We analyze the system behavior with respect to the frequency of the switching. By applying an averaging technique under the hypothesis of a high switching frequency, we find that although each value of the coupling does not produce synchronization, switching between the two at a high frequency stabilizes the synchronization manifold. However, we also find windows of synchronization below the value predicted by this technique, and we develop a master stability function to explain the appearance of these windows. Spectral properties of the system are a useful tool for understanding the dynamical properties and the synchronization failure in some intervals of the switching frequency. Numerical and experimental results in agreement with the analysis are presented.