Motile bacteria play essential roles in biology that rely on their dynamic behaviors, including their ability to navigate, interact, and selforganize. However, bacteria dynamics on fluid interfaces are not understood, despite the importance of interfaces in nature and the complexity of these highly anisotropic milieu. Fluid interfaces are highly non-ideal, complex domains that impose constraints that alter swimming behavior. We study flow fields generated by Pseudomonas aeruginosa PA01 in the pusher mode at aqueous-hexadecane interfaces. Analysis of correlated displacements of tracers and bacteria reveals flow fields with unexpected asymmetries that differ significantly from their counterparts in bulk fluids. These flow fields can be decomposed into fundamental hydrodynamic modes for swimmers in incompressible fluid interfaces. Experiments reveal an expected force-doublet mode corresponding to propulsion and drag at the interface plane, and a second dipolar mode, associated with forces exerted by the flagellum on the cell body in the aqueous phase that are countered by stresses in the interface. The balance of these modes depends on the bacteria's trapped interfacial configurations. The implications of these flows on enhanced transport and swimmer pair interactions are explored by investigating diffusion dynamics of tracer particles. This study identifies important factors of general interest regarding swimmers on or near fluid boundaries, and in the design of biomimetic swimmers to enhance transport at interfaces.