In [1], we proposed a universal method to reduce one-loop integrals with both tensor structure and higher-power propagators. But the method is quite redundant as it does not utilize the results of lower rank cases when addressing certain tensor integrals. Recently, we found a remarkable recursion relation [2, 3], where a tensor integral is reduced to lower-rank integrals and lower terms corresponding to integrals with one or more propagators being canceled. However, the expression of the lower terms is unknown. In this paper, we derive this non-trivial recursion relation for non-degenerate and degenerate cases and provides an explicit expression for the lower terms, thus simplifying and speeding up the reduction process.