One of the most commonly seeded crops in Canada is canola, a cultivar of oilseed rape (Brassica napus). As a mass‐flowering crop grown intensively throughout the Canadian Prairies, canola has the potential to influence pollinator success across tens of thousands of square kilometers of cropland. Bumble bees (Bombus sp.) are efficient pollinators of many types of native and crop plants. We measured the influence of this mass‐flowering crop on the abundance and phenology of bumble bees, and on another species of social bee (a sweat bee; Halictus rubicundus), by continuously deploying traps at different levels of canola cultivation intensity, spanning the start and end of canola bloom. Queen bumble bees were more abundant in areas with more canola cover, indicating that this crop is attractive to queens. However, bumble bee workers were significantly fewer in these locations later in the season, suggesting reduced colony success. The median collection dates of workers of three bumble bee species were earlier near canola fields, suggesting a dynamic response of colonies to the increased floral resources. Different species experienced this shift to different extents. The sweat bee was not affected by canola cultivation intensity. Our findings suggest that mass‐flowering crops such as canola are attractive to bumble bee queens and therefore may lead to higher rates of colony establishment, but also that colonies established near this crop may be less successful. We propose that the effect on bumble bees can be mitigated by spacing the crop more evenly with respect to alternate floral resources.