A great deal of research has shown people have sever capacity limits when they track objects in direct perception. But how many objects can people track in their imagination? In three pre-registered experiments, we examined the capacity limits of the imagination. Specifically, we examined how many objects people can mentally simulate simultaneously. In a novel Imagined Objects Tracking task, we had participants continue the motion of animated objects in their mind, and indicate when they collided with the ground. When tracking one object in the mind (Experiment 1a), participants gave excellent estimations compared to ground truth. But, with the addition of just one more object (Experiment 1b), their behavior altered qualitatively. Responses when tracking two objects in imagination were in line with the predictions of a Serial Model that mentally simulates only one object at a time, as opposed to a Parallel Model that simulates all objects in tandem. The serial bottleneck does not reflect response limitations (Experiment 2), and is reduced – but not eliminated – by adding extremely strong grouping cues (Experiment 3). The results suggest that the capacity limits of tracking in the imagination are quite severe, possibly restricted to a single object at a time.