We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of Transformerbased neural language models specialized for dialog, which have up to 137B parameters and are pre-trained on 1.56T words of public dialog data and web text. While model scaling alone can improve quality, it shows less improvements on safety and factual grounding. We demonstrate that fine-tuning with annotated data and enabling the model to consult external knowledge sources can lead to significant improvements towards the two key challenges of safety and factual grounding. The first challenge, safety, involves ensuring that the model's responses are consistent with a set of human values, such as preventing harmful suggestions and unfair bias. We quantify safety using a metric based on an illustrative set of human values, and we find that filtering candidate responses using a LaMDA classifier fine-tuned with a small amount of crowdworker-annotated data offers a promising approach to improving model safety. The second challenge, factual grounding, involves enabling the model to consult external knowledge sources, such as an information retrieval system, a language translator, and a calculator. We quantify factuality using a groundedness metric, and we find that our approach enables the model to generate responses grounded in known sources, rather than responses that merely sound plausible. Finally, we explore the use of LaMDA in the domains of education and content recommendations, and analyze their helpfulness and role consistency. * Work done while at Google.

Oxytocin neurons represent one of the major subsets of neurons in the paraventricular hypothalamus (PVH), a critical brain region for energy homeostasis. Despite substantial evidence supporting a role of oxytocin in body weight regulation, it remains controversial whether oxytocin neurons directly regulate body weight homeostasis, feeding or energy expenditure. Pharmacologic doses of oxytocin suppress feeding through a proposed melanocortin responsive projection from the PVH to the hindbrain. In contrast, deficiency in oxytocin or its receptor leads to reduced energy expenditure without feeding abnormalities. To test the physiological function of oxytocin neurons, we specifically ablated oxytocin neurons in adult mice. Our results show that oxytocin neuron ablation in adult animals has no effect on body weight, food intake or energy expenditure on a regular diet. Interestingly, male mice lacking oxytocin neurons are more sensitive to high fat diet-induced obesity due solely to reduced energy expenditure. In addition, despite a normal food intake, these mice exhibit a blunted food intake response to leptin administration. Thus, our study suggests that oxytocin neurons are required to resist the obesity associated with a high fat diet; but their role in feeding is permissive and can be compensated for by redundant pathways.

SUMMARY The melanocortin receptor 4 (MC4R) is a well-established mediator of body weight homeostasis. However, the neurotransmitter(s) that mediate MC4R function remain largely unknown and as a result, little is known about the second-order neurons of the MC4R neural pathway. Single minded 1 (Sim1)-expressing brain regions, which include the paraventricular nucleus of hypothalamus (PVH), represent key brain sites that mediate melanocortin action. We conditionally restored MC4R expression in Sim1 neurons in the background of Mc4r-null mice. The restoration dramatically reduced obesity in Mc4r-null mice. The anti-obesity effect was completely reversed by selective disruption of glutamate release from those same Sim1 neurons. The reversal was caused by lower energy expenditure and hyperphagia. Corroboratively, disruption of glutamate release selectively from adult PVH neurons led to rapid obesity development via reduced energy expenditure and hyperphagia. Thus, this study establishes glutamate as the primary neurotransmitter that mediates MC4Rs on Sim1 neurons in body weight regulation.

Summary Cre-loxP technology enables specific examination of the function and development of individual nuclei in the complex brain network. However, for most brain regions, the utilization of this technique has been hindered by the lack of mouse lines with Cre expression restricted to these regions. Here, we identified brain expressions of three transgenic Cre lines previously thought to be pancreas-specific. Cre expression driven by the rat-insulin promoter (Rip-Cre) was found mainly in the arcuate nucleus, and to a lesser degree in other hypothalamic regions. Cre expression driven by the neurogenin 3 promoter (Ngn3-Cre mice) was found in the ventromedial hypothalamus. Cre expression driven by the pancreas-duodenum homeobox 1 promoter (Pdx1-Cre) was found in several hypothalamic nuclei, the dorsal raphe and inferior olivary nuclei. Interestingly, Pdx1-Cre mediated deletion of vesicular GABA transporter led to postnatal growth retardation while Ngn3-Cre mediated deletion had no effects, suggesting a role for Pdx1-Cre neurons, but not pancreas, in the regulation of postnatal growth. These results demonstrate the potential for these Cre lines to study the function and development of brain neurons.

Feeding is known to be profoundly affected by stress-related emotional states and eating disorders are comorbid with psychiatric symptoms and altered emotional responses. The neural basis underlying feeding regulation by stress-related emotional changes is poorly understood. Here, we identify a novel projection from the paraventricular hypothalamus (PVH) to the ventral lateral septum (LSv) that shows a scalable regulation on feeding and behavioral changes related to emotion. Weak photostimulation of glutamatergic PVH→LSv terminals elicits stress-related self-grooming and strong photostimulation causes fear-related escape jumping associated with respective weak and strong inhibition on feeding. In contrast, inhibition of glutamatergic inputs to LSv increases feeding with signs of reduced anxiety. LSv-projecting neurons are concentrated in rostral PVH. LSv and LSv-projecting PVH neurons are activated by stressors in vivo, whereas feeding bouts were associated with reduced activity of these neurons. Thus, PVH→LSv neurotransmission underlies dynamic feeding by orchestrating emotional states, providing a novel neural circuit substrate underlying comorbidity between eating abnormalities and psychiatric disorders.

Overgrowth of white adipose tissue (WAT) in obesity occurs as a result of adipocyte hypertrophy and hyperplasia. Expansion and renewal of adipocytes relies on proliferation and differentiation of white adipocyte progenitors (WAP); however, the requirement of WAP for obesity development has not been proven. Here, we investigate whether depletion of WAP can be used to prevent WAT expansion. We test this approach by using a hunter-killer peptide designed to induce apoptosis selectively in WAP. We show that targeted WAP cytoablation results in a long-term WAT growth suppression despite increased caloric intake in a mouse diet-induced obesity model. Our data indicate that WAP depletion results in a compensatory population of adipose tissue with beige adipocytes. Consistent with reported thermogenic capacity of beige adipose tissue, WAP-depleted mice display increased energy expenditure. We conclude that targeting of white adipocyte progenitors could be developed as a strategy to sustained modulation of WAT metabolic activity.

No abstract

Lesions of the lateral hypothalamus (LH) cause hypophagia. However, activation of glutamatergic neurons in LH inhibits feeding. These results suggest a potential importance for other LH neurons in stimulating feeding. Our current study in mice showed that disruption of GABA release from adult LH GABAergic neurons reduced feeding. LH GABAergic neurons project extensively to the paraventricular hypothalamic nucleus (PVH), and optogenetic stimulation of GABAergic LH ¡ PVH fibers induced monosynaptic IPSCs in PVH neurons, and potently increased feeding, which depended on GABA release. In addition, disruption of GABA-A receptors in the PVH reduced feeding. Thus, we have identified a new feeding pathway in which GABAergic projections from the LH to the PVH promote feeding.