Under the pressure of rapid urbanization, the spatiotemporal dynamics of urban green spaces (UGS) have enormous impacts on the local ecological system and environment at different scales. In this study, UGS in Hefei City, which has experienced rapid urbanization from 1995 to 2015, were extracted based on time-series Landsat-5 TM and Landsat-8 OLI images, and different types of parks were mapped based on GF-2 images combined with multi-source metadata. Dynamic patterns of green space were examined by drawing the spatial variations of green space at the city, inner city, and park scales. Results revealed that: (1) At the city level, UGS decreased with the rapid urbanization, especially farmland sharply lost in areas around existing urban areas and along the transportation corridors. (2) At the inner-city level, concentric analyses showed that UGS changes in different rings had unique trends, and the dynamic changes were the most significant in Rings 2 and 3. Comparative analysis of old and new districts showed that the common characteristics of UGS changes were the transfer-out of farmland and the transfer-in of built-up land, and the newer the region, the more intense the changes. (3) At the park level, the number and area of urban parks were increasing from the center to the periphery, and the type of park gradually changed from single to rich. Significant spatial heterogeneity was identified in the landscape patterns of urban parks based on fishnet cell analysis. It is fundamental to assign urban construction land for socio-economic development, while planning UGS at different scales; moreover, integrating different green space-related policies could protect the UGS and maintain its stability. Only in this way can UGS combine economic, social, and ecological benefits under the background of rapid urbanization.