To realize ideal force/torque source in applications such as monopod hopping robots and assistive robots, force/torque controlled series elastic actuators(SEA) are widely used components. Most of existing SEA force/torque control approaches are based on the simple SEA whose force/torque output is proportional to the position of the motor with respect to the payload, however the structure of SEAs is becoming more and more complex, which leads to a nonlinear trend in SEA models. To overcome the problem, we propose a general control method, which is not restricted by the SEA mechanical structure, to control SEA output torque based on nonlinear disturbance observer(NDOB). Specifically, the presented strategy yields the first control solution, with guaranteed theoretical analysis, to successfully address the nonlinear SEA torque control problem, with simultaneous payload angular velocity identification as an additional benefit. The tracking performance of the designed control system is theoretically ensured by Lyapunov analysis. Furthermore, taking a nonlinear SEA for instance, simulation and experimental results suggest the effectiveness and superior performance of the proposed method by comparing it with existing method.