The output model of a rotating accelerometer gravity gradiometer (RAGG) established by the inertial dynamics method cannot reflect the change of signal frequency, and calibration sensitivity and self-gradient compensation effect for the RAGG is a very important stage in the development process that cannot be omitted. In this study, a model based on the outputs of accelerometers on the disc of RGAA is established to calculate the gravity gradient corresponding to the distance, through the study of the RAGG output influenced by a surrounding mass in the frequency domain. Taking particle, sphere, and cuboid as examples, the input-output models of gravity gradiometer are established based on the center gradient and four accelerometers, respectively. Simulation results show that, if the scale factors of the four accelerometers on the disk are the same, the output signal of the RAGG only contains (4k+2)ω ( ω is the spin frequency of disc for RAGG) harmonic components, and its amplitude is related to the orientation of the surrounding mass. Based on the results of numerical simulation of the three models, if the surrounding mass is close to the RAGG, the input-output models of gravity gradiometer are more accurate based on the four accelerometers. Finally, some advantages and disadvantages of cuboid and sphere are compared and some suggestions related to calibration and self-gradient compensation are given.