This brief review discusses the complexity paradigm and the sustainability of complex biological, ecological, and socio-economic systems. This paradigm is considered to complement the reductionism paradigm in explaining the natural phenomena. We suggest that the concepts used in theoretical physics can be considered to describe the specific case of complex systems and to develop their dynamical models.