Four heavy metals (Cd, Cu, Pb and Zn), two metalloids (As and Sb) and two rare metals (In and Tl) were selected as target elements to ascertain their concentrations and accumulation in the soil-plant system and their effects on the structure of the soil microbial community in a typical area of rare metal smelting in south China. Twenty-seven soil samples 100, 500, 1000, 1500 and 3000 m from the smelter and 42 vegetable samples were collected to determine the concentrations of the target elements. Changes in soil microorganisms were investigated using the Biolog test and 454 pyrosequencing. The concentrations of the eight target elements (especially As and Cd) were especially high in the topsoil 100 m from the smelter and decreased markedly with increasing distance from the smelter and with increasing soil depth. Cadmium bio-concentration factors in the vegetables were the highest followed by Tl, Cu, Zn, In, Sb, Pb, and then As. The concentrations of As, Cd and Pb in vegetables were 86.7, 100 and 80.0 %, respectively, over the permissible limits and possible contamination by Tl may also be of concern. Changes in soil microbial counts and average well colour development were also significantly different at different sampling distances from the smelter. The degree of tolerance to heavy metals appears to be fungi > bacteria > actinomycetes. The 454 pyrosequencing indicates that long-term metal contamination from the smelting activities has resulted in shifts in the composition of the soil bacterial community.