Chromium is not only an essential trace element for the growth and development of living organisms; it is also a heavy metal pollutant. Excessive chromium in farmland soil will not only cause harm to crops, but could also constitute a serious threat to human health through the cumulative effect of the food chain. The determination of heavy metals in tailings of farmland soil is an essential means of soil environmental protection and sustainable development. Hyperspectral remote sensing technology has good characteristics, e.g., high speed, macro, and high resolution, etc., and has gradually become a focus of research to determine heavy metal content in soil. However, due to the spectral variation caused by different environmental conditions, the direct application of the indoor spectrum to conduct field surveys is not effective. Soil components are complex, and the effect of linear regression of heavy metal content is not satisfactory. This study builds indoor and outdoor spectral conversion models to eliminate soil spectral differences caused by environmental conditions. Considering the complex effects of soil composition, we introduce a support vector machine model to retrieve chromium content that has advantages in solving problems such as small samples, non-linearity, and a large number of dimensions. Taking a mining area in Hunan, China as a test area, this study retrieved the chromium content in the soil using 12 combination models of three types of spectra (field spectrum, lab spectrum, and direct standardization (DS) spectrum), two regression methods (stepwise regression and support vector machine regression), and two factors (strong correlation factor and principal component factor). The results show that: (1) As far as the spectral types are concerned, the inversion accuracy of each combination of the field spectrum is generally lower than the accuracy of the corresponding combination of other spectral types, indicating that field environmental interference affects the modeling accuracy. Each combination of DS spectra has higher inversion accuracy than the corresponding combination of field spectra, indicating that DS spectra have a certain effect in eliminating soil spectral differences caused by environmental conditions. (2) The inversion accuracy of each spectrum type of SVR_SC (Support Vector Regression_Strong Correlation) is the highest for the combination of regression method and inversion factor. This indicates the feasibility and superiority of inversion of heavy metals in soil by a support vector machine. However, the inversion accuracy of each spectrum type of SVR_PC (Support Vector Regression_Principal Component) is generally lower than that of other combinations, which indicates that, to obtain superior inversion performance of SVR, the selection of characteristic factors is very important. (3) Through principal component regression analysis, it is found that the pre-processed spectrum is more stable for the inversion of Cr concentration. The regression coefficients of the three types of differential spectra are roughly the same. The five statistically significant characteristic bands are mostly around 384–458 nm, 959–993 nm, 1373–1448 nm, 1970–2014 nm, and 2325–2400 nm. The research results provide a useful reference for the large-scale normalization monitoring of chromium-contaminated soil. They also provide theoretical and technical support for soil environmental protection and sustainable development.
