Individual plants within a population may vary at both genetic and epigenetic levels. The rate of genetic divergence and its underlying mechanisms is well understood. Less is known about the factors contributing to epigenetic divergence among isogenic populations except that, despite the presence of mechanisms that faithfully maintain epigenetic marks, epigenetic differences are more frequent than genetic variation. Epigenetically divergent stretches of isogenic DNA sequence are called epialleles. Currently, it is not clear why certain regions exhibit variable epigenetic status. We identified and characterised two long RNA transcripts with altered expression and DNA methylation in an ago5 mutant. However, further investigation revealed that these changes were not dependent upon AGO5. Rather, the variable transcription of these loci in Arabidopsis mutant and wild-type populations corresponds to spontaneous differential methylated regions (DMRs) or epialleles. These two DMRs are delineated by RNAs which are highly expressed when the DMR is hypomethylated. Furthermore, they control the expression of 5′ transcriptional start site mRNA variants of nearby protein coding genes. Our data support the recent observations that meiotically stable DMRs exist within inbred populations. We further demonstrate that DMR boundaries can be defined by putative non-coding promoter-associated transcripts.