The use of ab initio methods for accurate simulations of electronic, phononic and electron-phonon properties of molecular materials such as organic crystals is a challenge that is often tackled stepwise based on molecular properties calculated in gas phase and perturbatively treated parameters relevant for solid phases. In contrast, in this work we report a full first-principles description of such properties for the prototypical rubrene crystals. More specifically, we determine a Holstein-Peierls type Hamiltonian for rubrene including local and nonlocal electron-phonon couplings. Thereby, a recipe for circumventing the issue of numerical inaccuracies with low-frequency phonons is presented. In addition, we study the phenyl group motion with a molecular dynamics approach.