Histone H3 lysine36 dimethylation (H3K36me2) is generally distributed in the gene body and euchromatic intergenic regions. However, we found that H3K36me2 is enriched in pericentromeric heterochromatin in some mouse cell lines. We here revealed the mechanism of heterochromatin targeting of H3K36me2. Among several H3K36 methyltransferases, NSD2 was responsible for inducing heterochromatic H3K36me2. Depletion and overexpression analyses of NSD2-associating proteins revealed that NSD2 recruitment to heterochromatin was mediated through the imitation switch (ISWI) chromatin remodeling complexes, such as BAZ1B-SMARCA5 (WICH), which directly binds to AT-rich DNA via a BAZ1B domain containing AT-hook-like motifs. The abundance and stoichiometry of NSD2, SMARCA5, and BAZ1B or BAZ2A could determine the localization of H3K36me2 in different cell types. To explore the physiological role of heterochromatic H3K36me2, we analyzed mouse tissues and embryos. As a result, H3K36me2 was found in heterochromatin at the 2- to 4-cell stages of mouse preimplantation embryos, suggesting its involvement in developmental regulation.