The effect of physical aging on the mechanics of amorphous solids as well as mechanical rejuvenation is modeled with nonequilibrium thermodynamics, using the concept of two thermal subsystems, namely a kinetic one and a configurational one. Earlier work (Semkiv and Hütter in J Non-Equilib Thermodyn 41(2):79-88, 2016) is extended to account for a fully general coupling of the two thermal subsystems. This coupling gives rise to hypoelastic-type contributions in the expression for the Cauchy stress tensor, that reduces to the more common hyperelastic case for sufficiently long aging. The general model, particularly the reversible and irreversible couplings between the thermal subsystems, is compared in detail with models in the literature (Boyce et al.