“…in cross-lingual (Schuster et al, 2019;Liu et al, 2019) or multilingual settings (Cao et al, 2020). In contrast to prior work, we experiment with aligning BERT using adversarial training, which is related to using adversarial training for domain adaptation (Ganin et al, 2016), coping with bias or confounding variables (Li et al, 2018;Raff and Sylvester, 2018;Zhang et al, 2018;Barrett et al, 2019;McHardy et al, 2019) or transferring models from a source to a target language (Zhang et al, 2017;Keung et al, 2019;Wang et al, 2019). Similar to Chen and Cardie (2018), we use a multinomial discriminator in our setting.…”