A nonblocking 4×4 optical switch with polarization selective elements has been proposed, which control configuration has been changed. Compared with other nonblocking 4×4 optical interconnection network with polarization selective elements, this switch has lower insertion loss and requires fewer elements. In this presentation, this nonblocking 4×4 optical switch will be dilated to increase the contrast ratio. Finally, a rearrangeable nonblocking network by this high contrast ratio nonblocking 4×4 optical switch will be proposed, which has higher signal-to-noise ratio, lowest system insertion loss, and fewest required components.