We have developed an efficient and accurate formalism which allows the simulation at the ab initio level of inelastic electron tunneling spectroscopy data under a scanning tunneling microscope setup. It exploits fully the tunneling regime by carrying out the structural optimization and vibrational mode calculations for surface and tip independently. The most relevant interactions in the inelastic current are identified as the inelastic tunneling terms, which are taken into account up to lowest order, while all other inelastic contributions are neglected. As long as the system is under tunneling regime conditions and there is no physisorbed molecule on the surface or tip apex, this lowest order in inelastic tunneling (LOIT) approach reduces drastically the computational cost compared to related approaches while maintaining a good accuracy. Adopting the wide-band limit for both tip and surface further reduces calculation times significantly, and is shown to give similar results to when the full energy dependence of the Green's functions is taken into account. The LOIT is applied to the Cu(111) + CO system probed by a clean and a CO contaminated tip to find good agreement with previous works. Different parameters involved in the calculations such as basis sets, k sampling, tip-sample distance, or temperature, among others, are discussed in detail.