In order to study the adhesion properties of fast-melting SBS-modified asphalt (SBS-T) at the interface with aggregates, the contact angles of three dosages of SBS-T asphalt with three liquids (distilled water, glycerol, and formamide) were determined by the sessile drop method based on surface free energy theory. The evaluation indexes such as cohesion, asphalt–aggregate adhesion, stripping work and energy ratio of the asphalt were analyzed and the adhesion properties of the asphalt–aggregate system were investigated with the help of micromechanical methods. The results indicate that SBS-T can improve the adhesion properties of the asphalt. Furthermore, as the dosage of the modifier increases, the cohesion work, adhesion work, and energy ratio of the SBS-T asphalt exhibit a similar rise. As the spalling work reduces and the adhesion between asphalt and aggregate improves, it is noteworthy that the SBS-T asphalt–aggregate system exhibits superior adhesion performance compared to the SBS-modified asphalt–aggregate system, despite the same dosage.