In this paper, we propose a novel energy saving scheme, termed the Gossip-based Sleep Protocol (GSP). With GSP, each node randomly goes to sleep for some time with gossip sleep probability p. When the value of p is small enough, the network stays connected. GSP does not require a wireless node to maintain the states of other nodes. It requires few operations and scales to large networks. We propose two versions of GSP, one for synchronous networks and one for asynchronous networks, and show the advantages of the GSP approach through both simulations and analysis.