Tracking fluorescent objects through movies is a critical first step in quantifying electrical or molecular dynamics in cells. In many applications, it is necessary to track large numbers of fluorescent objects moving through tissue in a nonrigid manner. In this submission, we describe the use of a graph attention-based neural network to detect-and-link fluorescent neuronal nuclei in the brain of freely behaving worms (C. elegans). This approach allows us to reliably match on average 33% of the cells. When combined with a nonrigid registration algorithm that can leverage partial matches, this approach allows efficient tracking of all cells with substantially less manual intervention. Further work is needed to integrate this into previous registration pipelines.