Vitamin A, ingested either as retinol or β-carotene from animal- or plant-derived foods respectively, is a nutrient essential for many biological functions such as embryonic development, vision, immune response, tissue remodeling, and metabolism. Its main active metabolite is all trans-retinoic acid (atRA), which regulates gene expression through the activation of α, β, and γ isotypes of the nuclear atRA receptor (RAR). More recently, retinol derivatives were also shown to control the RAR activity, enlightening the interplay between vitamin A metabolism and RAR-mediated transcriptional control. The white and brown adipose tissues regulate the energy homeostasis by providing dynamic fatty acid storing and oxidizing capacities to the organism, in connection with the other fatty acid-consuming tissues. This concerted interorgan response to fatty acid fluxes is orchestrated, in part, by the endocrine activity of the adipose tissue depots. The adipose tissues are also sites for synthesizing and storing vitamin A derivatives, which will act as hormonal cues or intracellularly to regulate essential aspects of adipocyte biology. As agents that prevent adipocyte differentiation hence, expected to decrease fat mass, and inducers of uncoupling protein expression, thus, favoring energy expenditure, retinoids have prompted many investigations to decipher their roles in adipose tissue pathophysiology, which are summarized in this review.