In this paper, we developed a Stroh-type formalism for anti-plane deformation and then investigated the fracture mechanics for an elliptical cavity in a magnetoelectroelastic solid under remotely uniform in-plane electromagnetic and/or anti-plane mechanical loading, which allowed us to take the electromagnetic field inside the cavity into account. Reducing the cavity into a crack, we had explicit solutions in closed forms for a mode III crack, which included the extreme cases for an impermeable crack and a permeable crack. The results were illustrated with plots, showing that in the absence of mechanical loads, an applied electric or magnetic field, positive or negative, always tended to close the crack. On the other hand, in the presence of a mechanical load, a negative electric or magnetic field retarded crack growth, while a positive field could either enhance or retard crack propagation, depending on the strengths of the applied electric/magnetic fields and the level of the mechanical load as well. In other words, the effect of electric/magnetic fields on the fracture behavior is mechanical load-dependent.