Transferring knowledge from a teacher neural network pretrained on the same or a similar task to a student neural network can significantly improve the performance of the student neural network. Existing knowledge transfer approaches match the activations or the corresponding handcrafted features of the teacher and the student networks. We propose an information-theoretic framework for knowledge transfer which formulates knowledge transfer as maximizing the mutual information between the teacher and the student networks. We compare our method with existing knowledge transfer methods on both knowledge distillation and transfer learning tasks and show that our method consistently outperforms existing methods. We further demonstrate the strength of our method on knowledge transfer across heterogeneous network architectures by transferring knowledge from a convolutional neural network (CNN) to a multi-layer perceptron (MLP) on CIFAR-10. The resulting MLP significantly outperforms the-state-of-the-art methods and it achieves similar performance to the CNN with a single convolutional layer.

Multi-fidelity modelling enables accurate inference of quantities of interest by synergistically combining realizations of low-cost/low-fidelity models with a small set of high-fidelity observations. This is particularly effective when the low- and high-fidelity models exhibit strong correlations, and can lead to significant computational gains over approaches that solely rely on high-fidelity models. However, in many cases of practical interest, low-fidelity models can only be well correlated to their high-fidelity counterparts for a specific range of input parameters, and potentially return wrong trends and erroneous predictions if probed outside of their validity regime. Here we put forth a probabilistic framework based on Gaussian process regression and nonlinear autoregressive schemes that is capable of learning complex nonlinear and space-dependent cross-correlations between models of variable fidelity, and can effectively safeguard against low-fidelity models that provide wrong trends. This introduces a new class of multi-fidelity information fusion algorithms that provide a fundamental extension to the existing linear autoregressive methodologies, while still maintaining the same algorithmic complexity and overall computational cost. The performance of the proposed methods is tested in several benchmark problems involving both synthetic and real multi-fidelity datasets from computational fluid dynamics simulations.

No abstract

Enzymes that bind and process ubiquitin, a small 76-amino-acid protein, have been recognized as pharmacological targets in oncology, immunological disorders, and neurodegeneration. Mass spectrometry technology has now reached the capacity to cover the proteome with enough depth to interrogate entire biochemical pathways including those that contain DUBs and E3 ligase substrates. We have recently characterized the breast cancer cell (MCF7) deep proteome by detecting and quantifying ~10,000 proteins, and within this data set, we can detect endogenous expression of 65 deubiquitylating enzymes (DUBs), whereas matching transcriptomics detected 78 DUB mRNAs. Since enzyme activity provides another meaningful layer of information in addition to the expression levels, we have combined advanced mass spectrometry technology, pre-fractionation, and more potent/selective ubiquitin active-site probes with propargylic-based electrophiles to profile 74 DUBs including distinguishable isoforms for 5 DUBs in MCF7 crude extract material. Competition experiments with cysteine alkylating agents and pan-DUB inhibitors combined with probe labeling revealed the proportion of active cellular DUBs directly engaged with probes by label-free quantitative (LFQ) mass spectrometry. This demonstrated that USP13, 39, and 40 are non-reactive to probe, indicating restricted enzymatic activity under these cellular conditions. Our extended chemoproteomics workflow increases depth of covering the active DUBome, including isoform-specific resolution, and provides the framework for more comprehensive cell-based small-molecule DUB selectivity profiling.

No abstract

BackgroundInterferon (IFN) signalling pathways, a key element of the innate immune response, contribute to resistance to conventional chemotherapy, radiotherapy, and immunotherapy, and are often deregulated in cancer. The deubiquitylating enzyme USP18 is a major negative regulator of the IFN signalling cascade and is the predominant human protease that cleaves ISG15, a ubiquitin-like protein tightly regulated in the context of innate immunity, from its modified substrate proteins in vivo. MethodsIn this study, using advanced proteomic techniques, we have significantly expanded the USP18-dependent ISGylome and proteome in a chronic myeloid leukaemia (CML)derived cell line. USP18-dependent effects were explored further in CML and colorectal carcinoma cellular models. ResultsNovel ISGylation targets were characterised that modulate the sensing of innate ligands, antigen presentation and secretion of cytokines. Consequently, CML USP18-deficient cells are more antigenic, driving increased activation of cytotoxic T lymphocytes (CTLs) and are more susceptible to irradiation. ConclusionsOur results provide strong evidence for USP18 in regulating antigenicity and radiosensitivity, highlighting its potential as a cancer target.

The parasitic protozoan Leishmania requires proteasomal, autophagic and lysosomal proteolytic pathways to enact the extensive cellular remodelling that occurs during its life cycle. The proteasome is essential for parasite proliferation, yet little is known about the requirement for ubiquitination/deubiquitination processes in growth and differentiation. Activitybased protein profiling of L. mexicana C12, C19 and C65 deubiquitinating cysteine peptidases (DUBs) revealed DUB activity remains relatively constant during differentiation of procyclic promastigote to amastigote. However, when life cycle phenotyping (bar-seq) was performed on a pool including 15 barcoded DUB null mutants created in promastigotes using CRISPR-Cas9, significant loss of fitness was observed during differentiation and intracellular infection. DUBs 4, 7, and 13 are required for successful transformation from metacyclic promastigote to amastigote and DUBs 3, 5, 6, 8, 10, 11 and 14 are required for normal amastigote proliferation in mice. DUBs 1, 2, 12 and 16 are essential for promastigote viability and the essential role of DUB2 in establishing infection was demonstrated using DiCre inducible gene deletion in vitro and in vivo. DUB2 is found in the nucleus and interacts with nuclear proteins associated with transcription/chromatin dynamics, mRNA splicing and mRNA capping. DUB2 has broad linkage specificity, cleaving all the di-ubiquitin chains except for Lys27 and Met1. Our study demonstrates the crucial role that DUBs play in differentiation and intracellular survival of Leishmania and that amastigotes are exquisitely sensitive to disruption of ubiquitination homeostasis.

Abstract-This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both the human and the robot. The framework, based on a biologically-grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in humanrobot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users.