A Concrete-filled Rectangular Steel Tube (CRST) frame structure is studied in this paper by shaking table model test and nonlinear simulation. A number of viscous dampers are employed to insure the function of the building especially under seismic action for some of the main vertical elements of the building are not continuous. A shaking table test of a scaled model was conducted under different earthquake waves to investigate the structural behavior. And the nonlinear time-history analysis for the shaking table test model was also carried out by finite element analysis program according to the shaking table test. The simulation model was constructed in accordance with the tested specimen and the simulation effect was then validated by the tested results. To sum up, (1) there are no obvious weak stories on the damping equipped structure; (2) the dampers can reduce the displacement of the irregular to a certain degree.