Lymph node (LN) lipomatosis is a common, but rarely discussed phenomenon, associated with aging, involving a gradual exchange of the LN parenchyma into adipose tissue. The mechanisms behind these changes and the effects on the LN have been unknown. We show that LN lipomatosis starts in the medullary regions of the human LN and link the initiation of lipomatosis to transdifferentiation of LN medullary fibroblasts into adipocytes. The latter is associated with a downregulation of lymphotoxin beta expression. We also show that medullary fibroblasts, in contrast to the reticular cells in the T-cell zone, display an inherent higher sensitivity for adipogenesis. Progression of lipomatosis leads to a gradual loss of the medullary lymphatic network, but at later stages, collecting-like lymphatic vessels, are found inside the adipose tissue. The stromal dysregulation includes a dramatic remodeling and dilation of the high endothelial venules associated with reduced density of naive T-cells. Abnormal clustering of plasma cells is also observed. Thus, LN lipomatosis causes widespread stromal dysfunction with consequences for the immune contexture of the human LN. Our data warrant an increased awareness of LN lipomatosis as a factor contributing to decreased immune functions in the elderly and in disease.