CD4 T cells have been implicated in cancer immunity for their helper functions. Moreover, their direct cytotoxic potential has been shown in some patients with cancer. Here, by mining single-cell RNA-seq datasets, we identified CD4 T cell clusters displaying cytotoxic phenotypes in different human cancers, resembling CD8 T cell profiles. Using the peptide-MHCII-multimer technology, we confirmed ex vivo the presence of cytolytic tumor-specific CD4 T cells. We performed an integrated phenotypic and functional characterization of these cells, down to the single-cell level, through a high-throughput nanobiochip consisting of massive arrays of picowells and machine learning. We demonstrated a direct, contact-, and granzyme-dependent cytotoxic activity against tumors, with delayed kinetics compared to classical cytotoxic lymphocytes. Last, we found that this cytotoxic activity was in part dependent on SLAMF7. Agonistic engagement of SLAMF7 enhanced cytotoxicity of tumor-specific CD4 T cells, suggesting that targeting these cells might prove synergistic with other cancer immunotherapies.

No abstract

No abstract

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However, one cannot easily address this task without observing ground truth annotation for the training data. To address this problem, we propose a novel deep learning model of Cross-Domain Representation Disentangler (CDRD). By observing fully annotated source-domain data and unlabeled target-domain data of interest, our model bridges the information across data domains and transfers the attribute information accordingly. Thus, cross-domain feature disentanglement and adaptation can be jointly performed. In the experiments, we provide qualitative results to verify our disentanglement capability. Moreover, we further confirm that our model can be applied for solving classification tasks of unsupervised domain adaptation, and performs favorably against state-of-the-art image disentanglement and translation methods.

No abstract

No abstract

Person re-identification (Re-ID) aims at recognizing the same person from images taken across different cameras. To address this task, one typically requires a large amount labeled data for training an effective Re-ID model, which might not be practical for real-world applications. To alleviate this limitation, we choose to exploit a sufficient amount of pre-existing labeled data from a different (auxiliary) dataset. By jointly considering such an auxiliary dataset and the dataset of interest (but without label information), our proposed adaptation and re-identification network (ARN) performs unsupervised domain adaptation, which leverages information across datasets and derives domain-invariant features for Re-ID purposes. In our experiments, we verify that our network performs favorably against state-of-the-art unsupervised Re-ID approaches, and even outperforms a number of baseline Re-ID methods which require fully supervised data for training.

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in robotics and multi-agent reinforcement learning, we formulate the problem as one where learned information must be shared across a set of agents in a bandwidth-sensitive manner to optimize for scene understanding tasks such as semantic segmentation. Inspired by networking communication protocols, we propose a multi-stage handshake communication mechanism where the neural network can learn to compress relevant information needed for each stage. Specifically, a target agent with degraded sensor data sends a compressed request, the other agents respond with matching scores, and the target agent determines who to connect with (i.e., receive information from). We additionally develop the AirSim-CP dataset and metrics based on the AirSim simulator where a group of aerial robots perceive diverse landscapes, such as roads, grasslands, buildings, etc. We show that for the semantic segmentation task, our handshake communication method significantly improves accuracy by approximately 20% over decentralized baselines, and is comparable to centralized ones using a quarter of the bandwidth.