A method of lensless holographic 3D display is proposed based on the fast calculated computer-generated hologram (CGH). The CGH is calculated by using a virtual nonuniform sampled wavefront recording plane (NS-WRP) which is close to the 3D object. The calculation process consists of two steps: first, the 3D object is calculated to the NS-WRP using nonuniform fast Fourier transform (NUFFT) based algorithm. Second, the NS-WRP is propagated to the CGH using Fresnel diffraction algorithm. This method can provide fast and simple calculation of CGH which can reconstruct high quality 3D object with perceptual depth cue in space. Both of simulation and experiment demonstrate the proposed method.