This study observes one of the ECG signal abnormalities, which is the Premature Ventricular Contraction (PVC). Many studies applied a machine learning technique to develop a computer-aided diagnosis to classify normal and PVC conditions of ECG signals. The common process to obtain information from the ECG signal is by performing a feature extraction process. Since the ECG signal is a complex signal, there is a need to reduce the signal dimension to produce an optimal feature set. However, these processes can remove the information contained in the signal. Therefore, this study process the original ECG signal using a Convolutional Neural Network to avoid losing information. The input data were in the form of both one beat of normal ECG signal or PVC with size 1x200. The classification used four layers of convolutional neural network (CNN). There were eight 1x1 filters used in the input. Simultaneously, 16 and 32 of 1x1 filters were used in the second and the fourth convolutional layers, respectively. Thus the system produced a fully connected layer consisted of 512 neurons, while the output layer consisted of 2 neurons. The system is tested using 11361 beats of ECG data and achieved the highest accuracy of 99.59%, with the 10-fold crossvalidation. This study emphasizes an opportunity to develop a wearable device to detect PVC since CNN can be implemented into an embedded system or an IoT based system.