In recent years, the application of artificial intelligence (AI) has had a significant impact on economic development. This study examined the relationship between the level of AI development and economic growth in 28 Chinese provinces from 2005 to 2018, and we focused on the mediating role of the industrial structure. We found that the unreasonable state of the structure is an important reason behind the slowdown of China’s economic growth. The development of AI not only has a direct effect on economic growth, but can also improve economic slowdown by inhibiting industrial structure upgrading. Taking into account regional heterogeneity, we also conducted sub-regional regressions, and the results show that this mediating effect is particularly significant in the eastern, central, and western areas of China; the regression results also show that the development of AI technologies did not boost the economy before the 2008 financial crisis, but during the economic recovery period, the R&D and application of AI helped China’s economy to rebound. Thus, AI has gradually become an important power engine for high-quality and sustainable growth in China’s economy.