The effects of a high biochar rate on soil carbon mineralization, when co-applied with excessive compost, have been reported in previous studies, but there is a dearth of studies focusing on soil nitrogen. In order to ascertain the positive or snegative effects of a higher biochar rate on excessive compost, compost (5 wt. %) and three slow pyrolysis (>700 °C) biochars (formosan ash (Fraxinus formosana Hayata), ash biochar; makino bamboo (Phyllostachys makino Hayata), bamboo biochar; and lead tree (Leucaena leucocephala (Lam.) de. Wit), lead tree biochar) were applied (0, 2 and 5 wt. %) to three soils (one Oxisols and two Inceptisols). Destructive sampling occurred at 1, 3, 7, 28, 56, 84, 140, 196, 294, and 400 days to monitor for changes in soil chemistry. The overall results showed that, compared to the other rates, the 5% biochar application rate significantly reduced the concentrations of inorganic N (NO3−-N + NH4+-N) in the following, decreasing order: lead tree biochar > bamboo biochar > ash biochar. The soil response in terms of ammonium and nitrate followed a similar declining trend in the three soils throughout the incubation periods, with this effect increasing in tandem with the biochar application rate. Over time, the soil NO3−-N increased, probably due to the excessive compost N mineralization; however, the levels of soil NO3−-N in the sample undergoing the 5% biochar application rate remained the lowest, to a significant degree. The soils’ original properties determined the degree of ammonium and nitrate reduction after biochar addition. To reduce soil NO3−-N pollution and increase the efficiency of compost fertilizer use, a high rate of biochar application (especially with that pyrolyzed at high temperatures (>700 °C)) to excessively compost-fertilized soils is highly recommended.