Despite the growing applications of smart glass Augmented Reality (AR) in heritage, there is not a framework that can serve as a base for designing meaningful and educational immersive heritage experiences. This article proposes such a prototype design framework for AR experiences in heritage sites, drawing on literature that connects affective experiences with learning, and practically exploring AR as a non-didactic storytelling medium. Smart glass AR is considered here an important technology milestone for creating affective interactions, one that offers visitors/viewers new ways to experience, embody, and have a physical and social interaction with a localized past, and learn about it.