We investigated the fate of trace elements (TE) in poplar wood on the conversion of biomass to heat in a 0.2 MW combustion unit equipped with a fabric filter. The phytoremediation wood was harvested from a TE-contaminated agricultural site planted with a high-density poplar stand. The combustion technology used in the present experiment allows for an efficient separation of the various ash fractions. The combustion process concentrates Cu, Cr, and Ni in the bottom ash, heat exchanger ash, and cyclone ash fractions. Therefore, the impact of the fabric filter is negligible for these elements. Conversely, Cd, Pb, and Zn are significantly recovered in the emission fraction in the absence of the fabric filter above the emission limits. The use of a fabric filter will allow the concentration of these three TEs in the ashes collected below the filter, thus complying with all regulatory thresholds, i.e., those from the large combustion plant EU directive. Because the TE concentrations in the different fractions differed significantly, it is recommended that these fractions be treated separately, especially when recycling of ashes from phytoremediation wood through application in agriculture is envisaged.