The bromodomain containing protein 4 (BRD4) recognizes acetylated histone proteins and plays numerous roles in the progression of a wide range of cancers, due to which it is under intense investigation as a novel anti-cancer drug target. In the present study, we performed three-dimensional quantitative structure activity relationship (3D-QSAR) molecular modeling on a series of 60 inhibitors of BRD4 protein using ligand- and structure-based alignment and different partial charges assignment methods by employing comparative molecular field analysis (CoMFA) and comparative molecular similarity indices analysis (CoMSIA) approaches. The developed models were validated using various statistical methods, including non-cross validated correlation coefficient (r2), leave-one-out (LOO) cross validated correlation coefficient (q2), bootstrapping, and Fisher’s randomization test. The highly reliable and predictive CoMFA (q2 = 0.569, r2 = 0.979) and CoMSIA (q2 = 0.500, r2 = 0.982) models were obtained from a structure-based 3D-QSAR approach using Merck molecular force field (MMFF94). The best models demonstrate that electrostatic and steric fields play an important role in the biological activities of these compounds. Hence, based on the contour maps information, new compounds were designed, and their binding modes were elucidated in BRD4 protein’s active site. Further, the activities and physicochemical properties of the designed molecules were also predicted using the best 3D-QSAR models. We believe that predicted models will help us to understand the structural requirements of BRD4 protein inhibitors that belong to quinolinone and quinazolinone classes for the designing of better active compounds.