Since their initial observation, contact sites formed between different organelles have transitioned from ignored curiosities to recognized centers for the exchange of metabolites and lipids. Contact formed between the ER and endomembrane system (eg. the plasma membrane, endosomes, and lysosomes) is of particular biomedical interest, as it governs aspects of lipid metabolism, organelle identity, and cell signaling. Here, we review the field of ER-endolysosomal communication from the perspective of three model systems: budding yeast, the fruit fly D. melanogaster, and mammals. From this broad perspective, inter-organelle communication displays a consistent role in metabolic regulation that was differentially tuned during the development of complex metazoan life. We also examine the current state of understanding of lipid exchange between organelles, and discuss molecular mechanisms by which this occurs.