For pipes connected by pipe joints, leaks in the pipeline system are likely to occur at the pipe joints as opposed to the tube itself. Thus, early detection is critical to ensure the safety of the pipeline system. Based on acoustic emission (AE) techniques, this paper presents an experimental research on small leak detection in gas distribution pipelines due to loosening of the pipe joint connection. Firstly, the acoustic characteristics of leak signals are studied; then, features of signals are extracted. Finally, a classifier based on the support vector machine (SVM) technology is established, and the qualified features are selected to detect the leak. It is verified that the main frequency of the AE small leak signal due to the failure of the pipe joint is focused in the range of 33–45 kHz, and the algorithms based on SVM with kernel functions all can reach a better estimation accuracy of 98% using the feature “envelope area” or the feature set {standard deviation (STD), root mean square (RMS), energy, average frequency}.