Anti-synthetase syndrome (ASSD) is a heterogeneous autoimmune disease characterised by multi-system involvement with a wide variety of manifestations. Validated classification criteria are necessary to improve recognition and prevent misclassification, especially given the lack of reliable and standardised autoantibody testing. We systematically reviewed the literature to analyse proposed ASSD criteria, characteristics, and diagnostic performance. PubMed and Embase databases (01/01/1984 to 06/11/2018) and the ACR and EULAR meeting abstracts (2017-2018. Sensitivities, specificities, positive, negative likelihood ratios and risk of bias were calculated for ASSD criteria and key variables reported in the literature. We performed meta-analysis when appropriate. Methods We searched ResultsWe retrieved 4,358 studies. We found 85 proposed ASSD criteria from a total of 82 studies. All but one study included anti-synthetase autoantibody (ARS) positivity in the ASSD criteria. Most studies required only one ASSD feature plus anti-ARS to define ASSD (n=64, 78%), whereas 16 studies required more than one ASSD variable plus anti-ARS. The only criteria not including anti-ARS positivity required 5 ASSD clinical features. We found limited data and wide variability in the diagnostic performance of each variable and definition proposed in the literature. Given these limitations we only meta-analysed the performance of individual muscle biopsy and clinical variables in diagnosing ASSD, which performed poorly. ConclusionThe current ASSD criteria include a variety of serological, clinical, and histological features with wide variability amongst proposed definitions and the performance of these definitions has not been tested. This systematic literature review suggests the need for additional data and consensus-driven classification criteria for ASSD.