In this paper, we study the gravity algebra structure on the negative cyclic homology or the cyclic cohomology of several classes of algebras. These algebras include: Calabi-Yau algebras, symmetric Frobenius algebras, unimodular Poisson algebras, and unimodular Frobenius Poisson algebras. The relationships among these gravity algebras are also discussed under some additional conditions.