“…At least certain forms of backpropagation appear compatible with a number of biological observations, e.g., spike timing-dependent plasticity (Scellier and Bengio, 2016 ). Deep neural networks that use spikes are becoming commonplace (Yu et al, 2013 ; Cao et al, 2015 ; Diehl et al, 2015 ; Hunsberger and Eliasmith, 2016 ; Kheradpisheh et al, 2016a ; Lee et al, 2016 ; Zambrano and Bohte, 2016 ), and attempts have also been made to introduce oscillatory components in deep networks (Rao and Cecchi, 2011 , 2013 ; Reichert and Serre, 2013 ). Finally, new DNN architectures are emerging with long-range feedforward (Huang et al, 2016a , b ) and feedback connectivity (Pascanu et al, 2013 ; Zilly et al, 2016 ).…”