In plants, the role of chloroplasts and mitochondria (plasmotype) in controlling circadian clock plasticity and overall plant robustness has not been elucidated. In this study, we investigated the rhythmicity of chlorophyll fluorescence (Chl F) clock output, and fitness in the field at optimal and elevated temperatures, in three different barley populations. First, we examined a reciprocal DH population between two wild barley (Hordeum vulgare ssp. spontaneum), in which we identified two pleiotropic QTLs (frp2.1 and amp7.1) that modulate clock and fitness including conditioning of these effects by plasmotype diversity. In the second population, a complete diallel consisting of 11 genotypes (reciprocal hybrids differing in plasmotype), we observed a gradual reduction in plasmotype, ranging from 26% and 15% for Chl F and clock measurements to 5.3% and 3.7% for growth and reproductive traits, respectively. The third population studied was a collection of cytolines in which nine different wild plasmotypes replaced the cultivated Noga (H. vulgare) plasmotype. Here, the order and magnitude of the effects of the plasmotypes differed from what we observed in the diallel population, with the greatest effect of plasmotype diversity observed for clock period and amplitude. Comparison of the chloroplast sequences suggests several candidate genes in the plastid-encoded RNA polymerase (PEP) complex that may be responsible for the observed plasmotype effects. Overall, our results unravel previously unknown cytonuclear epistatic interactions that controls clock performance while also having pleiotropic effects on a plant field characteristics.