Microbial diversity formed by ages of evolution in soils plays an important role in sustainability of crop production by enriching soil and alleviating biotic and abiotic stresses. This diversity is as an essential part of the agro-ecosystems, which is being pushed to edges by pumping agrochemicals and constant soil disturbances. Consequently, efficiency of cropping system has been decreasing, aggravated further by the increased incidence of abiotic stresses due to changes in climatic patterns. Thus, the sustainability of agriculture is at stake. Understanding the microbiota inhabiting phyllosphere, endosphere, spermosphere, rhizosphere, and non-rhizosphere, and its utilization could be a sustainable crop production strategy. This review explores the available information on diversity of beneficial microbes in agricultural ecosystem and synthesizes their commercial uses in agriculture. Microbiota in agro-ecosystem works by nutrient acquisition, enhancing nutrient availability, water uptake, and amelioration of abiotic and abiotic stresses. External application of such beneficial microbiota or microbial consortia helps in boosting plant growth and provides resistance to drought, salinity, heavy metal, high-temperature and radiation stress in various crop plants. These have been instrumental in enhancing tolerance to diseases, insect pest and nematodes in various cropping system. However, studies on the microbiome in revolutionary production systems like conservation agriculture and protected cultivation, which use lesser agrochemicals, are limited and if exploited can provide valuable input in sustainable agriculture production.