Neural-based multi-task learning has been successfully used in many real-world large-scale applications such as recommendation systems. For example, in movie recommendations, beyond providing users movies which they tend to purchase and watch, the system might also optimize for users liking the movies afterwards. With multi-task learning, we aim to build a single model that learns these multiple goals and tasks simultaneously. However, the prediction quality of commonly used multi-task models is often sensitive to the relationships between tasks. It is therefore important to study the modeling tradeo s between task-speci c objectives and inter-task relationships. In this work, we propose a novel multi-task learning approach, Multi-gate Mixture-of-Experts (MMoE), which explicitly learns to model task relationships from data. We adapt the Mixture-of-Experts (MoE) structure to multi-task learning by sharing the expert submodels across all tasks, while also having a gating network trained to optimize each task. To validate our approach on data with di erent levels of task relatedness, we rst apply it to a synthetic dataset where we control the task relatedness. We show that the proposed approach performs better than baseline methods when the tasks are less related. We also show that the MMoE structure results in an additional trainability bene t, depending on di erent levels of randomness in the training data and model initialization. Furthermore, we demonstrate the performance improvements by MMoE on real tasks including a binary classi cation benchmark, and a large-scale content recommendation system at Google.

Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks, how can we quantify them, and how should we address them?In this paper we offer a set of novel metrics for evaluating algorithmic fairness concerns in recommender systems. In particular we show how measuring fairness based on pairwise comparisons from randomized experiments provides a tractable means to reason about fairness in rankings from recommender systems. Building on this metric, we offer a new regularizer to encourage improving this metric during model training and thus improve fairness in the resulting rankings. We apply this pairwise regularization to a large-scale, production recommender system and show that we are able to significantly improve the system's pairwise fairness.

Wikipedia's brilliance and curse is that any user can edit any of the encyclopedia entries. We introduce the notion of the impact of an edit, measured by the number of times the edited version is viewed. Using several datasets, including recent logs of all article views, we show that an overwhelming majority of the viewed words were written by frequent editors and that this majority is increasing. Similarly, using the same impact measure, we show that the probability of a typical article view being damaged is small but increasing, and we present empirically grounded classes of damage. Finally, we make policy recommendations for Wikipedia and other wikis in light of these findings.

ORCID ID: 0000-0002-7224-8449 (Y.Z.).Mutations generated by CRISPR/Cas9 in Arabidopsis (Arabidopsis thaliana) are often somatic and are rarely heritable. Isolation of mutations in Cas9-free Arabidopsis plants can ensure the stable transmission of the identified mutations to next generations, but the process is laborious and inefficient. Here, we present a simple visual screen for Cas9-free T2 seeds, allowing us to quickly obtain Cas9-free Arabidopsis mutants in the T2 generation. To demonstrate this in principle, we targeted two sites in the AUXIN-BINDING PROTEIN1 (ABP1) gene, whose function as a membrane-associated auxin receptor has been challenged recently. We obtained many T1 plants with detectable mutations near the target sites, but only a small fraction of T1 plants yielded Cas9-free abp1 mutations in the T2 generation. Moreover, the mutations did not segregate in Mendelian fashion in the T2 generation. However, mutations identified in the Cas9-free T2 plants were stably transmitted to the T3 generation following Mendelian genetics. To further simplify the screening procedure, we simultaneously targeted two sites in ABP1 to generate large deletions, which can be easily identified by PCR. We successfully generated two abp1 alleles that contained 1,141-and 711-bp deletions in the ABP1 gene. All of the Cas9-free abp1 alleles we generated were stable and heritable. The method described here allows for effectively isolating Cas9-free heritable CRISPR mutants in Arabidopsis.

No abstract

Background-The haplotypes in the gene vitamin K epoxide reductase complex subunit 1 (VKORC1) have been found to affect warfarin dose response through effects on the formation of reduced-form vitamin K, a cofactor for ␥-carboxylation of vitamin K-dependent proteins, which is involved in the coagulation cascade and has a potential impact on atherosclerosis. We hypothesized that VKORC1-dependent effects on the coagulation cascade and atherosclerosis would contribute to susceptibility for vascular diseases. Methods and Results-To test the hypothesis, we studied the association of polymorphisms of VKORC1 with stroke (1811 patients), coronary heart disease (740 patients), and aortic dissection (253 patients) compared with matched controls (nϭ1811, 740, and 416, respectively). Five common noncoding single-nucleotide polymorphisms of VKORC1 were identified in a natural haplotype block with strong linkage disequilibrium (DЈϾ0.9, r 2 Ͼ0.9), then single-nucleotide polymorphism (SNP) ϩ2255 in the block was selected for the association study. We found that the presence of the C allele of the ϩ2255 locus conferred almost twice the risk of vascular disease (odds ratio [OR] 1.95, 95% confidence interval [CI] .58 to 2.41, PϽ0.001 for stroke; OR 1.72, 95% CI 1.24 to 2.38, PϽ0.01 for coronary heart disease; and OR 1.90, 95% CI 1.04 to 3.48, PϽ0.05 for aortic dissection). We also observed that subjects with the CC and CT genotypes had lower levels of undercarboxylated osteocalcin (a regulator for the bone), probably vascular calcification, and lower levels of protein induced in vitamin K absence or antagonism II (PIVKA-II, a des-␥-carboxy prothrombin) than those with TT genotypes. Conclusions-The haplotype of VKORC1 may serve as a novel genetic marker for the risk of stroke, coronary heart disease, and aortic dissection.

No abstract

The "wisdom of crowds" argument emphasizes the importance of diversity in online collaborations, such as open source projects and Wikipedia. However, decades of research on diversity in offline work groups have painted an inconclusive picture. On the one hand, the broader range of insights from a diverse group can lead to improved outcomes. On the other hand, individual differences can lead to conflict and diminished performance. In this paper, we examine the effects of group diversity on the amount of work accomplished and on member withdrawal behaviors in the context of WikiProjects. We find that increased diversity in experience with Wikipedia increases group productivity and decreases member withdrawal -up to a point. Beyond that point, group productivity remains high, but members are more likely to withdraw. Strikingly, no such diminishing returns were observed for differences in member interest, which increases productivity and decreases member withdrawal in a linear fashion. Our results suggest that the low visibility of individual differences in online groups may allow them to harvest more of the benefits of diversity while bearing less of the cost. We discuss how our findings can inform further research of online collaboration.